Jul 11 18:33:55 devstack cinder-volume[75898]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 18:33:55 devstack cinder-volume[75898]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:33:55 devstack cinder-volume[75898]: we strongly recommend against using it for new projects. Jul 11 18:33:55 devstack cinder-volume[75898]: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:33:55 devstack cinder-volume[75898]: framework. For more detail see Jul 11 18:33:55 devstack cinder-volume[75898]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:33:55 devstack cinder-volume[75898]: import eventlet # noqa Jul 11 18:33:58 devstack cinder-volume[75898]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:33:58 devstack cinder-volume[75898]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:33:58 devstack cinder-volume[75898]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:33:58 devstack cinder-volume[75898]: INFO dbcounter [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Registered counter for database cinder Jul 11 18:33:59 devstack cinder-volume[75898]: DEBUG oslo_db.sqlalchemy.engines [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:33:59 devstack cinder-volume[75898]: DEBUG dbcounter [-] [75898] Writer thread running {{(pid=75898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:33:59 devstack cinder-volume[75898]: INFO cinder.rpc [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 18:33:59 devstack cinder-volume[75898]: INFO cinder.rpc [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 18:33:59 devstack cinder-volume[75898]: DEBUG oslo_db.sqlalchemy.engines [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:33:59 devstack cinder-volume[75898]: INFO cinder.volume.manager [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Determined volume DB was empty at startup. Jul 11 18:33:59 devstack cinder-volume[75898]: DEBUG cinder.volume.manager [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75898) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 18:33:59 devstack cinder-volume[75898]: INFO cinder.volume.manager [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 18:33:59 devstack cinder-volume[75898]: WARNING stevedore.named [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 18:33:59 devstack cinder-volume[75898]: WARNING castellan.key_manager [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:33:59 devstack cinder-volume[75898]: WARNING cinder.keymgr.conf_key_mgr [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:33:59 devstack cinder-volume[75898]: DEBUG cinder.volume.drivers.lvm [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75898) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 11 18:33:59 devstack cinder-volume[75898]: DEBUG oslo_concurrency.processutils [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_concurrency.processutils [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] CMD "cinder-rtstool verify" returned: 0 in 0.631s {{(pid=75898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_db.sqlalchemy.engines [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:34:00 devstack cinder-volume[75898]: INFO cinder.rpc [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 11 18:34:00 devstack cinder-volume[75898]: INFO cinder.rpc [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 11 18:34:00 devstack cinder-volume[75898]: WARNING stevedore.named [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 18:34:00 devstack cinder-volume[75898]: WARNING castellan.key_manager [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:34:00 devstack cinder-volume[75898]: INFO cinder.volume.manager [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_db.sqlalchemy.engines [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:34:00 devstack cinder-volume[75898]: INFO oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Starting 1 workers Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Started child 76065 {{(pid=75898) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Full set of CONF: {{(pid=75898) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] ******************************************************************************** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Configuration options gathered from: {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] ================================================================================ {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] allow_availability_zone_fallback = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] allow_compression_on_image_upload = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] allowed_direct_url_schemes = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] api_rate_limit = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[76065]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] auth_strategy = keystone {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] az_cache_duration = 3600 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_availability_zone = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_host = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_stats_polling_interval = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backup_api_class = cinder.backup.api.API {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backup_name_template = backup-%s {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backup_use_same_host = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backup_use_temp_snapshot = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] chap_password = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] chap_username = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_internal_tenant_project_id = c7ab7acbeb084296ad359d422fcdeb7a {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_internal_tenant_user_id = b08705dbcf8a40ef94e4ad7b5972f9f3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cloned_volume_same_az = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cluster = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] compression_format = gzip {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] compute_api_class = cinder.compute.nova.API {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] config_dir = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] config_source = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] control_exchange = openstack {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] debug = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] default_availability_zone = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] default_group_type = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] default_volume_type = lvmdriver-1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] disk_geometry = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] driver_client_cert = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] driver_client_cert_key = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] driver_data_namespace = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] driver_ssl_cert_path = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] driver_ssl_cert_verify = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] driver_use_ssl = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] enable_force_upload = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] enable_new_services = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] enable_unsupported_driver = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] enabled_backends = ['lvmdriver-1'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] enforce_multipath_for_image_xfer = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] filter_function = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_api_insecure = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_api_servers = ['http://192.168.122.79/image'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_api_ssl_compression = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_ca_certificates_file = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_catalog_info = image:glance:publicURL {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_certfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_keyfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_num_retries = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance_request_timeout = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] goodness_function = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] graceful_shutdown_timeout = 5 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] group_api_class = cinder.group.api.API {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] host = devstack {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_compress_on_upload = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_conversion_address_space_limit = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_conversion_cpu_limit = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_conversion_disable = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_upload_use_cinder_backend = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_upload_use_internal_tenant = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_volume_cache_enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_volume_cache_max_count = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] image_volume_cache_max_size_gb = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] init_host_max_objects_retrieval = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] instance_format = [instance: %(uuid)s] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] iscsi_target_flags = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] iscsi_write_cache = on {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] iser_helper = tgtadm {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] iser_ip_address = 192.168.122.79 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] iser_port = 3260 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_color = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_config_append = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_dir = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[76065]: INFO cinder.volume.manager [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_file = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_options = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_rotate_interval = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_rotate_interval_type = days {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] log_rotation_type = none {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] max_age = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] max_logfile_count = 30 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] max_logfile_size_mb = 200 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] max_over_subscription_ratio = 20.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] message_reap_interval = 86400 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] message_ttl = 2592000 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] migration_create_volume_timeout_secs = 300 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] monkey_patch = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] monkey_patch_modules = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] my_ip = 192.168.122.79 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] no_snapshot_gb_quota = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] num_iser_scan_tries = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] num_shell_tries = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] num_volume_device_scan_tries = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] nvmeof_conn_info_version = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] nvmet_ns_id = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] nvmet_port_id = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] osapi_max_limit = 1000 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] osapi_volume_ext_list = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] osapi_volume_listen_port = 8776 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] osapi_volume_use_ssl = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] osapi_volume_workers = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] per_volume_size_limit = -1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] periodic_fuzzy_delay = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] periodic_interval = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] public_endpoint = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] publish_errors = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] quota_backup_gigabytes = 1000 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] quota_backups = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] quota_gigabytes = 1000 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] quota_groups = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] quota_snapshots = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] quota_volumes = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] rate_limit_burst = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] rate_limit_except_level = CRITICAL {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] rate_limit_interval = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] reinit_driver_count = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] replication_device = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] report_discard_supported = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] report_interval = 120 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] reservation_clean_interval = 86400 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] reservation_expire = 86400 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] reserved_image_namespaces = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] reserved_percentage = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] rpc_response_timeout = 120 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] run_external_periodic_tasks = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] scst_target_driver = iscsi {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] scst_target_iqn_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_down_time = 720 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] shell_completion = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] snapshot_name_template = snapshot-%s {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] snapshot_same_host = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] split_loggers = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] state_path = /opt/stack/data/cinder {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] storage_availability_zone = nova {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] storage_protocol = iSCSI {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] syslog_log_facility = LOG_USER {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] target_helper = lioadm {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] target_ip_address = 192.168.122.79 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] target_port = 3260 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] target_protocol = iscsi {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] target_secondary_ip_addresses = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] trace_flags = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] transport_url = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] until_refresh = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] use_chap_auth = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] use_default_quota_class = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] use_journal = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] use_json = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] use_multipath_for_image_xfer = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] use_stderr = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] use_syslog = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] verify_glance_signatures = enabled {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_api_class = cinder.volume.api.API {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_backend_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_clear = zero {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_clear_ionice = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_clear_size = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack sudo[76070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack sudo[76070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:00 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_copy_bps_limit = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_dd_blocksize = 1M {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_name_template = volume-%s {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_service_inithost_offload = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volume_usage_audit_period = month {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] zoning_mode = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_concurrency.disable_process_locking = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.auth_section = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.auth_type = password {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.auth_version = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.cache = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.certfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.include_service_catalog = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:00 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.insecure = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.interface = public {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.keyfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_password = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcache_username = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.region_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.service_token_roles_required = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.service_type = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.79/identity {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.backend = dogpile.cache.null {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.backend_argument = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.backend_expiration_time = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.config_prefix = cache.oslo {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.debug_cache_backend = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.enable_retry_client = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.enable_socket_keepalive = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.expiration_time = 600 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.hashclient_retry_attempts = 2 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.memcache_dead_retry = 300 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.memcache_pool_maxsize = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.memcache_sasl_enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.password = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.proxies = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.redis_db = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.redis_server = localhost:6379 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.retry_attempts = 2 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.retry_delay = 0.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.socket_keepalive_count = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.socket_keepalive_idle = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.socket_keepalive_interval = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.socket_timeout = 1.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.tls_allowed_ciphers = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.tls_cafile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.tls_certfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.tls_enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.tls_keyfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cache.username = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] coordination.backend_url = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.asyncio_connection = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.asyncio_slave_connection = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.backend = sqlalchemy {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.connection = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.connection_debug = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.connection_parameters = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.connection_recycle_time = 3600 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.connection_trace = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.db_inc_retry_interval = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.db_max_retries = 20 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.db_max_retry_interval = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.db_retry_interval = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.max_overflow = 50 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.max_pool_size = 5 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.max_retries = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.mysql_wsrep_sync_wait = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.pool_timeout = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.retry_interval = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.slave_connection = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.sqlite_synchronous = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.synchronous_reader = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] database.use_db_reconnect = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.connection_string = messaging:// {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.es_doc_type = notification {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.es_scroll_size = 10000 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.es_scroll_time = 2m {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.filter_error_trace = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.hmac_keys = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.sentinel_service_name = mymaster {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.socket_timeout = 0.1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.trace_requests = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler.trace_sqlalchemy = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler_jaeger.process_tags = {} {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler_jaeger.service_name_prefix = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] profiler_otlp.service_name_prefix = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.enforce_new_defaults = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.enforce_scope = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.policy_default_rule = default {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.policy_file = policy.yaml {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] privsep_osbrick.group = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] privsep_osbrick.helper_command = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] privsep_osbrick.user = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_sys_admin.group = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_sys_admin.helper_command = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] cinder_sys_admin.user = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.auth_section = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.auth_type = password {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.cafile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.certfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.collect_timing = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.insecure = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.keyfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.send_service_user_token = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.split_loggers = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] service_user.timeout = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.auth_section = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.auth_type = password {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.certfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.collect_timing = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.insecure = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.keyfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.region_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.split_loggers = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] glance.timeout = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.backend_availability_zone = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.chap_password = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.chap_username = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.disk_geometry = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.driver_client_cert = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.driver_client_cert_key = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.driver_data_namespace = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.driver_use_ssl = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.extra_capabilities = {} {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.filter_function = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.goodness_function = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.iscsi_target_flags = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.iscsi_write_cache = on {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.iser_helper = tgtadm {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.iser_ip_address = 192.168.122.79 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.iser_port = 3260 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.lvm_mirrors = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.lvm_share_target = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.lvm_type = auto {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.num_shell_tries = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.replication_device = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.report_discard_supported = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.reserved_percentage = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.target_helper = tgtadm {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.target_ip_address = 192.168.122.79 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.target_port = 3260 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.target_protocol = iscsi {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.trace_flags = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.unique_fqdn_network = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.use_chap_auth = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_backend_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_clear = zero {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_clear_ionice = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_clear_size = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volume_group = cinder-volumes {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_reports.file_event_handler = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_reports.log_dir = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.backend_availability_zone = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.backend_host = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.chap_password = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.chap_username = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.chiscsi_conf = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.disk_geometry = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.driver_client_cert = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.driver_data_namespace = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.driver_use_ssl = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.extra_capabilities = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.filter_function = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.goodness_function = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.iser_helper = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.iser_ip_address = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.iser_port = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.iser_target_prefix = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.lvm_conf_file = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.lvm_mirrors = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.lvm_share_target = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.lvm_type = auto {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.num_shell_tries = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.nvmet_port_id = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.replication_device = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.report_discard_supported = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.reserved_percentage = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.scst_target_driver = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.storage_protocol = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.target_helper = lioadm {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.target_ip_address = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.target_port = 3260 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.target_protocol = iscsi {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.trace_flags = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.use_chap_auth = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_clear = zero {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_clear_size = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] lvmdriver-1.volumes_dir = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.ssl = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_notifications.driver = [] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_notifications.retry = -1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] key_manager.fixed_key = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.barbican_api_version = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.barbican_endpoint = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.barbican_endpoint_type = public {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.barbican_region_name = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.cafile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.certfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.collect_timing = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.insecure = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.keyfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.number_of_retries = 60 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.retry_delay = 1 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.send_service_user_token = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.split_loggers = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.timeout = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.verify_ssl = True {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican.verify_ssl_path = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.auth_section = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.auth_type = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.cafile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.certfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.collect_timing = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.insecure = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.keyfile = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.split_loggers = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] barbican_service_user.timeout = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.approle_role_id = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.approle_secret_id = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.auth_method = approle {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.auth_path = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.kv_mountpoint = secret {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.kv_path = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.kv_version = 2 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.namespace = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.root_token_id = **** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.ssl_ca_crt_file = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.timeout = 60.0 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.token_file = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.token_role = None {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.use_ssl = False {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:34:00 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] ******************************************************************************** {{(pid=75898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 18:34:01 devstack sudo[76070]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:01 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:01 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:01 devstack sudo[76256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:01 devstack sudo[76256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:01 devstack sudo[76256]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:01 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.664s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:01 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:34:01 devstack cinder-volume[76065]: INFO cinder.brick.local_dev.lvm [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 11 18:34:01 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:01 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:01 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:01 devstack sudo[76477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:34:01 devstack sudo[76477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:02 devstack sudo[76477]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:02 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:02 devstack cinder-volume[76065]: DEBUG cinder.brick.local_dev.lvm [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76065) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 11 18:34:02 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:02 devstack sudo[76636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:02 devstack sudo[76636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:03 devstack sudo[76636]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:03 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.049s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:03 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:03 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:03 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:03 devstack sudo[76834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:03 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:04 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:04 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.756s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:04 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:04 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:04 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:04 devstack sudo[76849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 11 18:34:04 devstack sudo[76849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:05 devstack sudo[76849]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:05 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.664s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:05 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:05 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:34:05 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:05 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:05 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:05 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:05 devstack sudo[76859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:34:05 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:06 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:06 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.837s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:06 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:06 devstack sudo[76869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:06 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:07 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:07 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.873s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:07 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:07 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:07 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:08 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:08 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.818s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:08 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:08 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:08 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:08 devstack sudo[76883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:08 devstack sudo[76883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:09 devstack sudo[76883]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:09 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.829s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:09 devstack cinder-volume[76065]: INFO cinder.volume.drivers.lvm [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 11 18:34:09 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:09 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:09 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:09 devstack sudo[76916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:09 devstack sudo[76916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:09 devstack sudo[76916]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:09 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.680s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:09 devstack cinder-volume[76065]: DEBUG cinder.volume.drivers.lvm [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Updating volume stats {{(pid=76065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 18:34:09 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:09 devstack sudo[77009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:34:09 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:10 devstack cinder-volume[75898]: DEBUG dbcounter [-] [75898] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:34:10 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:10 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:10 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:10 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:10 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:11 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:11 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:11 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:11 devstack sudo[77155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:11 devstack sudo[77155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:11 devstack sudo[77155]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:11 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:11 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:11 devstack sudo[77159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:11 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:12 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:12 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:12 devstack cinder-volume[76065]: INFO cinder.volume.driver [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 18:34:12 devstack cinder-volume[76065]: DEBUG cinder.volume.driver [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76065) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 18:34:12 devstack cinder-volume[76065]: DEBUG oslo_db.sqlalchemy.engines [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76065) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:34:12 devstack cinder-volume[76065]: DEBUG dbcounter [-] [76065] Writer thread running {{(pid=76065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:34:12 devstack cinder-volume[76065]: DEBUG cinder.db.api [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Building query based on filter {{(pid=76065) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 18:34:12 devstack cinder-volume[76065]: DEBUG cinder.image.image_utils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76065) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 18:34:12 devstack cinder-volume[76065]: INFO cinder.keymgr.migration [None req-46d8c869-05ef-4df9-b8b2-6e2a74cc6d85 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 18:34:12 devstack cinder-volume[76065]: DEBUG cinder.volume.drivers.lvm [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Updating volume stats {{(pid=76065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 18:34:12 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:12 devstack sudo[77163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:34:12 devstack sudo[77163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:13 devstack sudo[77163]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:13 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:13 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:13 devstack sudo[77170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:13 devstack sudo[77170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:14 devstack sudo[77170]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:14 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:14 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:14 devstack sudo[77174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:14 devstack sudo[77174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:14 devstack sudo[77174]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:14 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.747s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:14 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:14 devstack sudo[77184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:14 devstack sudo[77184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:15 devstack sudo[77184]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:15 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:15 devstack cinder-volume[76065]: DEBUG cinder.manager [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Notifying Schedulers of capabilities ... {{(pid=76065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:34:15 devstack cinder-volume[76065]: INFO cinder.volume.manager [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Driver initialization completed successfully. Jul 11 18:34:15 devstack cinder-volume[76065]: INFO cinder.manager [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Initiating service 2 cleanup Jul 11 18:34:15 devstack cinder-volume[76065]: INFO cinder.manager [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Service 2 cleanup completed. Jul 11 18:34:15 devstack cinder-volume[76065]: DEBUG cinder.service [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Creating RPC server for service cinder-volume {{(pid=76065) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 18:34:15 devstack cinder-volume[76065]: DEBUG cinder.service [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76065) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 18:34:15 devstack cinder-volume[76065]: INFO cinder.volume.manager [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 11 18:34:15 devstack cinder-volume[76065]: DEBUG cinder.volume.drivers.lvm [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Updating volume stats {{(pid=76065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 18:34:15 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:15 devstack sudo[77188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:34:15 devstack sudo[77188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:16 devstack sudo[77188]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:16 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:16 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:16 devstack sudo[77192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:16 devstack sudo[77192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:17 devstack sudo[77192]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:17 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:17 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:17 devstack sudo[77251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:17 devstack sudo[77251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:17 devstack sudo[77251]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:17 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:17 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:17 devstack sudo[77254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:17 devstack sudo[77254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:18 devstack sudo[77254]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:18 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:18 devstack cinder-volume[76065]: INFO cinder.volume.manager [None req-e8194983-de64-4b8b-a04f-de8934e36b05 None None] Driver post RPC initialization completed successfully. Jul 11 18:34:25 devstack cinder-volume[76065]: DEBUG dbcounter [-] [76065] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:34:28 devstack cinder-volume[76065]: DEBUG dbcounter [-] [76065] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:34:36 devstack cinder-volume[76065]: DEBUG oslo_service.periodic_task [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running periodic task VolumeManager._thread_info {{(pid=76065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:34:36 devstack cinder-volume[76065]: DEBUG cinder.volume.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] thread count: 6 {{(pid=76065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:34:36 devstack cinder-volume[76065]: DEBUG cinder.volume.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] thread info: [<_MainThread(MainThread, started 127979823640704)>, , , , , ] {{(pid=76065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:35:36 devstack cinder-volume[76065]: DEBUG oslo_service.periodic_task [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:35:36 devstack cinder-volume[76065]: DEBUG cinder.volume.drivers.lvm [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Updating volume stats {{(pid=76065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 18:35:36 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:35:36 devstack sudo[79564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:35:36 devstack sudo[79564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:35:37 devstack sudo[79564]: pam_unix(sudo:session): session closed for user root Jul 11 18:35:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:35:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:35:37 devstack sudo[79567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:35:37 devstack sudo[79567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:35:37 devstack sudo[79567]: pam_unix(sudo:session): session closed for user root Jul 11 18:35:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:35:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:35:37 devstack sudo[79570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:35:37 devstack sudo[79570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:35:38 devstack sudo[79570]: pam_unix(sudo:session): session closed for user root Jul 11 18:35:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:35:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:35:38 devstack sudo[79573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:35:38 devstack sudo[79573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:35:38 devstack sudo[79573]: pam_unix(sudo:session): session closed for user root Jul 11 18:35:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:35:38 devstack cinder-volume[76065]: DEBUG cinder.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Notifying Schedulers of capabilities ... {{(pid=76065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:35:38 devstack cinder-volume[76065]: DEBUG oslo_service.periodic_task [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running periodic task VolumeManager._thread_info {{(pid=76065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:35:38 devstack cinder-volume[76065]: DEBUG cinder.volume.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] thread count: 6 {{(pid=76065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:35:38 devstack cinder-volume[76065]: DEBUG cinder.volume.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] thread info: [<_MainThread(MainThread, started 127979823640704)>, , , , , ] {{(pid=76065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:36:28 devstack cinder-volume[76065]: DEBUG dbcounter [-] [76065] Writing DB stats cinder:SELECT=1 {{(pid=76065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:36:28 devstack cinder-volume[76065]: DEBUG dbcounter [-] [76065] Writing DB stats cinder:UPDATE=1 {{(pid=76065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:36:36 devstack cinder-volume[76065]: DEBUG oslo_service.periodic_task [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:36:36 devstack cinder-volume[76065]: DEBUG cinder.volume.drivers.lvm [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Updating volume stats {{(pid=76065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 18:36:36 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:36:36 devstack sudo[82558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:36:36 devstack sudo[82558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:36:37 devstack sudo[82558]: pam_unix(sudo:session): session closed for user root Jul 11 18:36:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:36:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:36:37 devstack sudo[82561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:36:37 devstack sudo[82561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:36:37 devstack sudo[82561]: pam_unix(sudo:session): session closed for user root Jul 11 18:36:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:36:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:36:37 devstack sudo[82564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:36:37 devstack sudo[82564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:36:38 devstack sudo[82564]: pam_unix(sudo:session): session closed for user root Jul 11 18:36:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:36:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:36:38 devstack sudo[82567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:36:38 devstack sudo[82567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:36:39 devstack sudo[82567]: pam_unix(sudo:session): session closed for user root Jul 11 18:36:39 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:36:39 devstack cinder-volume[76065]: DEBUG cinder.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Notifying Schedulers of capabilities ... {{(pid=76065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:36:39 devstack cinder-volume[76065]: DEBUG oslo_service.periodic_task [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running periodic task VolumeManager._thread_info {{(pid=76065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:36:39 devstack cinder-volume[76065]: DEBUG cinder.volume.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] thread count: 6 {{(pid=76065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:36:39 devstack cinder-volume[76065]: DEBUG cinder.volume.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] thread info: [<_MainThread(MainThread, started 127979823640704)>, , , , , ] {{(pid=76065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:37:36 devstack cinder-volume[76065]: DEBUG oslo_service.periodic_task [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:37:36 devstack cinder-volume[76065]: DEBUG cinder.volume.drivers.lvm [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Updating volume stats {{(pid=76065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 18:37:36 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:36 devstack sudo[84744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:37:36 devstack sudo[84744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:37 devstack sudo[84744]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:37 devstack sudo[84785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:37:37 devstack sudo[84785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:37 devstack sudo[84785]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:37 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:37:37 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:38 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:38 devstack sudo[84798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:37:38 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:39 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:39 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:39 devstack cinder-volume[76065]: DEBUG cinder.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Notifying Schedulers of capabilities ... {{(pid=76065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:37:39 devstack cinder-volume[76065]: DEBUG oslo_service.periodic_task [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running periodic task VolumeManager._thread_info {{(pid=76065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:37:39 devstack cinder-volume[76065]: DEBUG cinder.volume.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] thread count: 6 {{(pid=76065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:37:39 devstack cinder-volume[76065]: DEBUG cinder.volume.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] thread info: [<_MainThread(MainThread, started 127979823640704)>, , , , , ] {{(pid=76065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:38:28 devstack cinder-volume[76065]: DEBUG dbcounter [-] [76065] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:38:36 devstack cinder-volume[76065]: DEBUG oslo_service.periodic_task [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:38:36 devstack cinder-volume[76065]: DEBUG cinder.volume.drivers.lvm [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Updating volume stats {{(pid=76065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 18:38:36 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:36 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:38:36 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:37 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:37 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:38:37 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:37 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:37 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:37 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:38:37 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:38 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:38 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:38 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:38:38 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:39 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:39 devstack cinder-volume[76065]: DEBUG oslo_concurrency.processutils [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:39 devstack cinder-volume[76065]: DEBUG cinder.manager [None req-2ff00669-735a-4689-b249-ef90825b7dc8 None None] Notifying Schedulers of capabilities ... {{(pid=76065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:38:44 devstack cinder-volume[75898]: INFO oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Caught SIGTERM, stopping children Jul 11 18:38:44 devstack cinder-volume[75898]: DEBUG oslo_concurrency.lockutils [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Acquiring lock "singleton_lock" {{(pid=75898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:38:44 devstack cinder-volume[75898]: DEBUG oslo_concurrency.lockutils [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Acquired lock "singleton_lock" {{(pid=75898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:38:44 devstack cinder-volume[75898]: DEBUG oslo_concurrency.lockutils [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Releasing lock "singleton_lock" {{(pid=75898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:38:44 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Stop services. {{(pid=75898) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 18:38:44 devstack cinder-volume[75898]: DEBUG oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Killing children. {{(pid=75898) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 18:38:44 devstack cinder-volume[75898]: INFO oslo_service.backend._eventlet.service [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Waiting on 1 children to exit Jul 11 18:38:49 devstack cinder-volume[76065]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 11 18:38:49 devstack cinder-volume[86230]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 18:38:49 devstack cinder-volume[86230]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:38:49 devstack cinder-volume[86230]: we strongly recommend against using it for new projects. Jul 11 18:38:49 devstack cinder-volume[86230]: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:38:49 devstack cinder-volume[86230]: framework. For more detail see Jul 11 18:38:49 devstack cinder-volume[86230]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:38:49 devstack cinder-volume[86230]: import eventlet # noqa Jul 11 18:38:50 devstack cinder-volume[76065]: DEBUG oslo_concurrency.lockutils [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Acquiring lock "singleton_lock" {{(pid=76065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:38:50 devstack cinder-volume[76065]: DEBUG oslo_concurrency.lockutils [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Acquired lock "singleton_lock" {{(pid=76065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:38:50 devstack cinder-volume[76065]: DEBUG oslo_concurrency.lockutils [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Releasing lock "singleton_lock" {{(pid=76065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:38:50 devstack cinder-volume[76065]: WARNING amqp [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 18:38:50 devstack cinder-volume[76065]: WARNING amqp [None req-73bb23d4-c189-476a-aca5-70299f6b9d6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 18:38:51 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:38:51 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:38:51 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:38:52 devstack cinder-volume[86230]: INFO dbcounter [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Registered counter for database cinder Jul 11 18:38:52 devstack cinder-volume[86230]: DEBUG oslo_db.sqlalchemy.engines [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG dbcounter [-] [86230] Writer thread running {{(pid=86230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:38:53 devstack cinder-volume[86230]: INFO cinder.rpc [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 18:38:53 devstack cinder-volume[86230]: INFO cinder.rpc [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_db.sqlalchemy.engines [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:38:53 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Determined volume DB was empty at startup. Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG cinder.volume.manager [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86230) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 18:38:53 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 18:38:53 devstack cinder-volume[86230]: WARNING stevedore.named [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 18:38:53 devstack cinder-volume[86230]: WARNING castellan.key_manager [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:38:53 devstack cinder-volume[86230]: WARNING cinder.keymgr.conf_key_mgr [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:38:53 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_db.sqlalchemy.engines [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:38:53 devstack cinder-volume[86230]: INFO oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Starting 1 workers Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Started child 86550 {{(pid=86230) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Full set of CONF: {{(pid=86230) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] ******************************************************************************** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Configuration options gathered from: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] ================================================================================ {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] allow_availability_zone_fallback = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] allow_compression_on_image_upload = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] allowed_direct_url_schemes = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] api_rate_limit = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] auth_strategy = keystone {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_availability_zone = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_host = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_stats_polling_interval = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backup_api_class = cinder.backup.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backup_name_template = backup-%s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backup_use_same_host = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backup_use_temp_snapshot = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] chap_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] chap_username = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_internal_tenant_project_id = c7ab7acbeb084296ad359d422fcdeb7a {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_internal_tenant_user_id = b08705dbcf8a40ef94e4ad7b5972f9f3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cluster = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] compression_format = gzip {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] compute_api_class = cinder.compute.nova.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] config_dir = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] config_source = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] control_exchange = openstack {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] debug = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] default_availability_zone = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] default_group_type = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] default_volume_type = QuobyteHD {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] disk_geometry = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86550]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] driver_client_cert = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] driver_client_cert_key = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] driver_data_namespace = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] driver_ssl_cert_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] driver_ssl_cert_verify = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] driver_use_ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] enable_new_services = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] enable_unsupported_driver = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] enabled_backends = ['QuobyteHD'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] enforce_multipath_for_image_xfer = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] filter_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_api_insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_api_servers = ['http://192.168.122.79/image'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_api_ssl_compression = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_ca_certificates_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_catalog_info = image:glance:publicURL {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_num_retries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance_request_timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] goodness_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] graceful_shutdown_timeout = 5 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] group_api_class = cinder.group.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] host = devstack {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_compress_on_upload = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_conversion_address_space_limit = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_conversion_cpu_limit = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_conversion_disable = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_upload_use_cinder_backend = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_upload_use_internal_tenant = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_volume_cache_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_volume_cache_max_count = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] init_host_max_objects_retrieval = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] instance_format = [instance: %(uuid)s] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] iscsi_target_flags = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] iscsi_write_cache = on {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] iser_helper = tgtadm {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] iser_ip_address = 192.168.122.79 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] iser_port = 3260 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_color = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_config_append = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_dir = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_options = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_rotate_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_rotate_interval_type = days {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] log_rotation_type = none {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] max_age = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] max_logfile_count = 30 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] max_logfile_size_mb = 200 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] max_over_subscription_ratio = 20.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] message_reap_interval = 86400 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] message_ttl = 2592000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] monkey_patch = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] monkey_patch_modules = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] my_ip = 192.168.122.79 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] no_snapshot_gb_quota = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] num_iser_scan_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] num_shell_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] num_volume_device_scan_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] nvmeof_conn_info_version = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] nvmet_ns_id = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] nvmet_port_id = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] osapi_max_limit = 1000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] osapi_volume_ext_list = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] osapi_volume_listen_port = 8776 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] osapi_volume_use_ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] osapi_volume_workers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] per_volume_size_limit = -1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] periodic_fuzzy_delay = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] periodic_interval = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] public_endpoint = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] publish_errors = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] quota_backup_gigabytes = 1000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] quota_backups = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] quota_gigabytes = 1000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] quota_groups = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] quota_snapshots = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] quota_volumes = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] rate_limit_burst = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] rate_limit_except_level = CRITICAL {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] rate_limit_interval = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] reinit_driver_count = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] replication_device = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] report_discard_supported = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] report_interval = 120 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] reservation_clean_interval = 86400 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] reservation_expire = 86400 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] reserved_image_namespaces = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] reserved_percentage = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] rpc_response_timeout = 120 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] run_external_periodic_tasks = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] scst_target_driver = iscsi {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86550]: INFO cinder.volume.manager [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] scst_target_iqn_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_down_time = 720 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] shell_completion = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.remotefs [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86550) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] snapshot_name_template = snapshot-%s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] state_path = /opt/stack/data/cinder {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] storage_availability_zone = nova {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] storage_protocol = iSCSI {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] syslog_log_facility = LOG_USER {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] target_helper = lioadm {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] target_ip_address = 192.168.122.79 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] target_port = 3260 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] target_protocol = iscsi {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] target_secondary_ip_addresses = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] trace_flags = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] transport_url = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] until_refresh = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] use_chap_auth = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] use_default_quota_class = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] use_journal = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] use_json = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] use_multipath_for_image_xfer = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] use_stderr = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] use_syslog = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] verify_glance_signatures = enabled {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_api_class = cinder.volume.api.API {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_backend_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_clear = zero {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_clear_ionice = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_clear_size = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_copy_bps_limit = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_dd_blocksize = 1M {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_name_template = volume-%s {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_service_inithost_offload = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volume_usage_audit_period = month {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] zoning_mode = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.auth_section = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.auth_type = password {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.auth_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.cache = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.interface = public {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_password = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcache_username = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.region_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.service_type = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.79/identity {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.backend = dogpile.cache.null {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.backend_argument = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.backend_expiration_time = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.config_prefix = cache.oslo {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.debug_cache_backend = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.enable_retry_client = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.enable_socket_keepalive = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.expiration_time = 600 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.memcache_dead_retry = 300 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.memcache_pool_maxsize = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.memcache_sasl_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.proxies = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.redis_db = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.redis_server = localhost:6379 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.retry_attempts = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.retry_delay = 0.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.socket_keepalive_count = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.socket_keepalive_idle = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.socket_keepalive_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.socket_timeout = 1.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.tls_allowed_ciphers = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.tls_cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.tls_certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.tls_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.tls_keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cache.username = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] coordination.backend_url = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.asyncio_connection = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.asyncio_slave_connection = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.backend = sqlalchemy {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.connection = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.connection_debug = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.connection_parameters = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.connection_recycle_time = 3600 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.connection_trace = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.db_inc_retry_interval = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.db_max_retries = 20 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.db_max_retry_interval = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.db_retry_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.max_overflow = 50 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.max_pool_size = 5 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.max_retries = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.pool_timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.retry_interval = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.slave_connection = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.sqlite_synchronous = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.synchronous_reader = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] database.use_db_reconnect = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.connection_string = messaging:// {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.es_doc_type = notification {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.es_scroll_size = 10000 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.es_scroll_time = 2m {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.filter_error_trace = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.hmac_keys = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.sentinel_service_name = mymaster {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.socket_timeout = 0.1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.trace_requests = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler.trace_sqlalchemy = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler_jaeger.process_tags = {} {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] profiler_otlp.service_name_prefix = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.enforce_scope = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.policy_default_rule = default {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.policy_file = policy.yaml {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] privsep_osbrick.group = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] privsep_osbrick.helper_command = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] privsep_osbrick.user = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_sys_admin.group = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_sys_admin.helper_command = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] cinder_sys_admin.user = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.auth_section = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.auth_type = password {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.collect_timing = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.send_service_user_token = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86550) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 18:38:53 devstack cinder-volume[86550]: WARNING cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: WARNING cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] service_user.timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.auth_section = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.auth_type = password {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Running cmd (subprocess): mount.quobyte {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.collect_timing = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.region_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] glance.timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.backend_availability_zone = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.chap_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.chap_username = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.disk_geometry = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.driver_client_cert = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.driver_data_namespace = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.driver_use_ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.extra_capabilities = {} {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.filter_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.goodness_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.iscsi_target_flags = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.iser_helper = tgtadm {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.iser_ip_address = 192.168.122.79 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.iser_port = 3260 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_host = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_login = admin {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_mount_options = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_private_key = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_share_path = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.replication_device = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.report_discard_supported = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.target_helper = tgtadm {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.target_ip_address = 192.168.122.79 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.target_port = 3260 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.target_protocol = iscsi {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.trace_flags = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.use_chap_auth = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volume_backend_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volume_clear = zero {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_reports.file_event_handler = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_reports.log_dir = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.backend_host = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.chap_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack quobyte-client[86551]: Reading configuration file: /etc/quobyte/client.cfg Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.chap_username = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.chiscsi_conf = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.disk_geometry = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.driver_client_cert = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack quobyte-client[86551]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.driver_use_ssl = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.extra_capabilities = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.filter_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.goodness_function = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.iser_helper = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.iser_ip_address = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.iser_port = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.iser_target_prefix = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_host = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_login = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_mount_options = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_password = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_private_key = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_share_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_ssh_port = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.num_shell_tries = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.nvmet_port_id = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.replication_device = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.report_discard_supported = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.reserved_percentage = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.scst_target_driver = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.storage_protocol = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.target_helper = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.target_ip_address = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.target_port = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.target_prefix = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.target_protocol = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.trace_flags = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.use_chap_auth = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volume_clear = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volume_clear_size = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] QuobyteHD.volumes_dir = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_notifications.driver = [] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] key_manager.fixed_key = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.barbican_api_version = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.barbican_endpoint = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.barbican_endpoint_type = public {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=86550) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.barbican_region_name = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: INFO cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a ... Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.collect_timing = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c -c /etc/quobyte/client-cinder.cfg {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.number_of_retries = 60 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.retry_delay = 1 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.send_service_user_token = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.verify_ssl = True {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican.verify_ssl_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.auth_section = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.auth_type = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.cafile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.certfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.collect_timing = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.insecure = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.keyfile = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.split_loggers = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] barbican_service_user.timeout = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.approle_role_id = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.approle_secret_id = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.auth_method = approle {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.auth_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.kv_mountpoint = secret {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c -c /etc/quobyte/client-cinder.cfg Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.kv_path = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.kv_version = 2 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.namespace = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.root_token_id = **** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.ssl_ca_crt_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.timeout = 60.0 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.token_file = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.token_role = None {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.use_ssl = False {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:38:53 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] ******************************************************************************** {{(pid=86230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 18:38:54 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:54 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.866s {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:54 devstack cinder-volume[86550]: INFO cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a succeeded Jul 11 18:38:54 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=86550) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:38:54 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.877s {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:38:54 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:54 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:38:54 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:55 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.665s {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:55 devstack cinder-volume[86550]: INFO cinder.volume.driver [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Driver hasn't implemented _init_vendor_properties() Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG cinder.volume.driver [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86550) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG oslo_db.sqlalchemy.engines [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86550) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG dbcounter [-] [86550] Writer thread running {{(pid=86550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG cinder.db.api [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Building query based on filter {{(pid=86550) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG cinder.image.image_utils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86550) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 18:38:55 devstack cinder-volume[86550]: INFO cinder.keymgr.migration [None req-b91ba4e5-c629-42e7-b350-350df200f809 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=86550) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=86550) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:38:55 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:55 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:38:55 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:56 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.652s {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG cinder.manager [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Notifying Schedulers of capabilities ... {{(pid=86550) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:38:56 devstack cinder-volume[86550]: INFO cinder.volume.manager [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Driver initialization completed successfully. Jul 11 18:38:56 devstack cinder-volume[86550]: INFO cinder.manager [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Initiating service 3 cleanup Jul 11 18:38:56 devstack cinder-volume[86550]: INFO cinder.manager [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Service 3 cleanup completed. Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG cinder.service [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Creating RPC server for service cinder-volume {{(pid=86550) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG cinder.service [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86550) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 18:38:56 devstack cinder-volume[86550]: INFO cinder.volume.manager [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=86550) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=86550) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:38:56 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:56 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:38:56 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:57 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:57 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.738s {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:57 devstack cinder-volume[86550]: INFO cinder.volume.manager [None req-2474b3dc-b33f-42b7-b969-0bc64856e6cb None None] Driver post RPC initialization completed successfully. Jul 11 18:39:01 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-73ee1f0a-f5fd-4e20-b420-0f4eded6f631 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:01 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-73ee1f0a-f5fd-4e20-b420-0f4eded6f631 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:01 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-73ee1f0a-f5fd-4e20-b420-0f4eded6f631 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=86550) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:01 devstack cinder-volume[86550]: DEBUG cinder.volume.drivers.quobyte [None req-73ee1f0a-f5fd-4e20-b420-0f4eded6f631 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=86550) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:01 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-73ee1f0a-f5fd-4e20-b420-0f4eded6f631 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86550) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:01 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-73ee1f0a-f5fd-4e20-b420-0f4eded6f631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:01 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:39:01 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:02 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:02 devstack cinder-volume[86550]: DEBUG oslo_concurrency.processutils [None req-73ee1f0a-f5fd-4e20-b420-0f4eded6f631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.619s {{(pid=86550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:02 devstack cinder-volume[86550]: DEBUG cinder.manager [None req-73ee1f0a-f5fd-4e20-b420-0f4eded6f631 None None] Notifying Schedulers of capabilities ... {{(pid=86550) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:39:03 devstack cinder-volume[86230]: DEBUG dbcounter [-] [86230] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:39:04 devstack cinder-volume[86230]: INFO oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Caught SIGTERM, stopping children Jul 11 18:39:04 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Acquiring lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:39:04 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Acquired lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:39:04 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Releasing lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:39:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Stop services. {{(pid=86230) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 18:39:04 devstack cinder-volume[86230]: DEBUG oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Killing children. {{(pid=86230) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 18:39:04 devstack cinder-volume[86230]: INFO oslo_service.backend._eventlet.service [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Waiting on 1 children to exit Jul 11 18:39:07 devstack cinder-volume[86550]: DEBUG dbcounter [-] [86550] Writing DB stats cinder:SELECT=3 {{(pid=86550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:39:07 devstack cinder-volume[86550]: DEBUG dbcounter [-] [86550] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:39:09 devstack cinder-volume[86550]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 11 18:39:09 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Acquiring lock "singleton_lock" {{(pid=86550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:39:09 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Acquired lock "singleton_lock" {{(pid=86550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:39:09 devstack cinder-volume[86550]: DEBUG oslo_concurrency.lockutils [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Releasing lock "singleton_lock" {{(pid=86550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:39:09 devstack cinder-volume[86550]: WARNING amqp [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 18:39:09 devstack cinder-volume[86550]: WARNING amqp [None req-ed3b259c-37ee-40a1-9048-816118e308f2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 18:39:09 devstack cinder-volume[86925]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 18:39:09 devstack cinder-volume[86925]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:39:09 devstack cinder-volume[86925]: we strongly recommend against using it for new projects. Jul 11 18:39:09 devstack cinder-volume[86925]: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:39:09 devstack cinder-volume[86925]: framework. For more detail see Jul 11 18:39:09 devstack cinder-volume[86925]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:39:09 devstack cinder-volume[86925]: import eventlet # noqa Jul 11 18:39:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:39:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:39:12 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:39:13 devstack cinder-volume[86925]: INFO dbcounter [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Registered counter for database cinder Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writer thread running {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:39:13 devstack cinder-volume[86925]: INFO cinder.rpc [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 18:39:13 devstack cinder-volume[86925]: INFO cinder.rpc [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:39:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Determined volume DB was empty at startup. Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG cinder.volume.manager [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86925) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 18:39:13 devstack cinder-volume[86925]: WARNING stevedore.named [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 18:39:13 devstack cinder-volume[86925]: WARNING castellan.key_manager [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:39:13 devstack cinder-volume[86925]: WARNING cinder.keymgr.conf_key_mgr [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:39:13 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:39:13 devstack cinder-volume[86925]: INFO oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Starting 1 workers Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Started child 87167 {{(pid=86925) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Full set of CONF: {{(pid=86925) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] ******************************************************************************** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] Configuration options gathered from: {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] ================================================================================ {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 18:39:13 devstack cinder-volume[87167]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] allow_availability_zone_fallback = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] allow_compression_on_image_upload = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] allowed_direct_url_schemes = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] api_rate_limit = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] auth_strategy = keystone {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_availability_zone = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_host = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_stats_polling_interval = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backup_api_class = cinder.backup.api.API {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backup_name_template = backup-%s {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backup_use_same_host = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backup_use_temp_snapshot = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] chap_password = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] chap_username = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_internal_tenant_project_id = c7ab7acbeb084296ad359d422fcdeb7a {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_internal_tenant_user_id = b08705dbcf8a40ef94e4ad7b5972f9f3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cluster = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] compression_format = gzip {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] compute_api_class = cinder.compute.nova.API {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] config_dir = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] config_source = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] control_exchange = openstack {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] debug = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] default_availability_zone = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] default_group_type = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] default_volume_type = QuobyteHD {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] disk_geometry = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] driver_client_cert = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] driver_client_cert_key = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] driver_data_namespace = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] driver_ssl_cert_path = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] driver_ssl_cert_verify = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] driver_use_ssl = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] enable_new_services = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] enable_unsupported_driver = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] enabled_backends = ['QuobyteHD'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] enforce_multipath_for_image_xfer = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] filter_function = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_api_insecure = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_api_servers = ['http://192.168.122.79/image'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_api_ssl_compression = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_ca_certificates_file = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_catalog_info = image:glance:publicURL {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_certfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_keyfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_num_retries = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance_request_timeout = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] goodness_function = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] graceful_shutdown_timeout = 5 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] group_api_class = cinder.group.api.API {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] host = devstack {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_compress_on_upload = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_conversion_address_space_limit = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_conversion_cpu_limit = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_conversion_disable = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_upload_use_cinder_backend = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_upload_use_internal_tenant = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_volume_cache_enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_volume_cache_max_count = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] image_volume_cache_max_size_gb = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] init_host_max_objects_retrieval = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] instance_format = [instance: %(uuid)s] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] iscsi_target_flags = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] iscsi_write_cache = on {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] iser_helper = tgtadm {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] iser_ip_address = 192.168.122.79 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87167) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] iser_port = 3260 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_color = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_config_append = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_dir = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_file = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_options = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_rotate_interval = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_rotate_interval_type = days {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] log_rotation_type = none {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] max_age = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] max_logfile_count = 30 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] max_logfile_size_mb = 200 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] max_over_subscription_ratio = 20.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] message_reap_interval = 86400 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] message_ttl = 2592000 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] migration_create_volume_timeout_secs = 300 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] monkey_patch = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] monkey_patch_modules = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] my_ip = 192.168.122.79 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] no_snapshot_gb_quota = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] num_iser_scan_tries = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] num_shell_tries = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] num_volume_device_scan_tries = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] nvmeof_conn_info_version = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] nvmet_ns_id = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] nvmet_port_id = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] osapi_max_limit = 1000 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] osapi_volume_ext_list = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] osapi_volume_listen_port = 8776 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] osapi_volume_use_ssl = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] osapi_volume_workers = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] per_volume_size_limit = -1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] periodic_fuzzy_delay = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] periodic_interval = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] public_endpoint = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] publish_errors = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] quota_backup_gigabytes = 1000 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] quota_backups = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] quota_gigabytes = 1000 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] quota_groups = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] quota_snapshots = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] quota_volumes = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] rate_limit_burst = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] rate_limit_except_level = CRITICAL {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] rate_limit_interval = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] reinit_driver_count = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] replication_device = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] report_discard_supported = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] report_interval = 120 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] reservation_clean_interval = 86400 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] reservation_expire = 86400 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] reserved_image_namespaces = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] reserved_percentage = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] rpc_response_timeout = 120 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] run_external_periodic_tasks = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] scst_target_driver = iscsi {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] scst_target_iqn_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_down_time = 720 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] shell_completion = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] snapshot_name_template = snapshot-%s {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] split_loggers = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] state_path = /opt/stack/data/cinder {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] storage_availability_zone = nova {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] storage_protocol = iSCSI {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] syslog_log_facility = LOG_USER {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] target_helper = lioadm {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] target_ip_address = 192.168.122.79 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] target_port = 3260 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] target_protocol = iscsi {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] target_secondary_ip_addresses = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] trace_flags = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] transport_url = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] until_refresh = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] use_chap_auth = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] use_default_quota_class = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] use_journal = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] use_json = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] use_multipath_for_image_xfer = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] use_stderr = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] use_syslog = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] verify_glance_signatures = enabled {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_api_class = cinder.volume.api.API {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_backend_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_clear = zero {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_clear_ionice = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_clear_size = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_copy_bps_limit = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_dd_blocksize = 1M {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_name_template = volume-%s {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_service_inithost_offload = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volume_usage_audit_period = month {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] zoning_mode = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_concurrency.disable_process_locking = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.auth_section = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.auth_type = password {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.auth_version = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.cache = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.certfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.include_service_catalog = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.insecure = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.interface = public {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.keyfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_password = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcache_username = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.region_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.service_type = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.79/identity {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.backend = dogpile.cache.null {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.backend_argument = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.backend_expiration_time = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.config_prefix = cache.oslo {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.debug_cache_backend = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.enable_retry_client = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87167) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.enable_socket_keepalive = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 18:39:13 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.expiration_time = 600 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.hashclient_retry_attempts = 2 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Running cmd (subprocess): mount.quobyte {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.memcache_dead_retry = 300 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.memcache_pool_maxsize = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.memcache_sasl_enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.password = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.proxies = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.redis_db = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.redis_server = localhost:6379 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.retry_attempts = 2 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.retry_delay = 0.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.socket_keepalive_count = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.socket_keepalive_idle = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.socket_keepalive_interval = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.socket_timeout = 1.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.tls_allowed_ciphers = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.tls_cafile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.tls_certfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.tls_enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.tls_keyfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cache.username = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] coordination.backend_url = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.asyncio_connection = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.asyncio_slave_connection = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.backend = sqlalchemy {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.connection = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.connection_debug = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.connection_parameters = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.connection_recycle_time = 3600 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.connection_trace = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.db_inc_retry_interval = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.db_max_retries = 20 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.db_max_retry_interval = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.db_retry_interval = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.max_overflow = 50 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.max_pool_size = 5 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.max_retries = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.mysql_wsrep_sync_wait = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.pool_timeout = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.retry_interval = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.slave_connection = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.sqlite_synchronous = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.synchronous_reader = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] database.use_db_reconnect = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.connection_string = messaging:// {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.es_doc_type = notification {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.es_scroll_size = 10000 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.es_scroll_time = 2m {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.filter_error_trace = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.hmac_keys = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.sentinel_service_name = mymaster {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.socket_timeout = 0.1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.trace_requests = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler.trace_sqlalchemy = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler_jaeger.process_tags = {} {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler_jaeger.service_name_prefix = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] profiler_otlp.service_name_prefix = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.enforce_new_defaults = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.enforce_scope = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.policy_default_rule = default {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.policy_file = policy.yaml {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] privsep_osbrick.group = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] privsep_osbrick.helper_command = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] privsep_osbrick.user = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_sys_admin.group = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_sys_admin.helper_command = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] cinder_sys_admin.user = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.auth_section = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.auth_type = password {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.cafile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.certfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.collect_timing = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.insecure = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.keyfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.send_service_user_token = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.split_loggers = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] service_user.timeout = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack quobyte-client[87172]: Reading configuration file: /etc/quobyte/client.cfg Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.auth_section = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.auth_type = password {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.certfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.collect_timing = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack quobyte-client[87172]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.insecure = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.keyfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.region_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.split_loggers = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] glance.timeout = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.backend_availability_zone = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.chap_password = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.chap_username = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.disk_geometry = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.driver_client_cert = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.driver_client_cert_key = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.driver_data_namespace = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.driver_use_ssl = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.extra_capabilities = {} {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.filter_function = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.goodness_function = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.iscsi_target_flags = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.iscsi_write_cache = on {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.iser_helper = tgtadm {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.iser_ip_address = 192.168.122.79 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.iser_port = 3260 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_host = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_login = admin {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_mount_options = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_password = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_private_key = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_share_path = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.num_shell_tries = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.quobyte_volume_url = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.replication_device = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.report_discard_supported = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.reserved_percentage = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.target_helper = tgtadm {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.target_ip_address = 192.168.122.79 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.target_port = 3260 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.target_protocol = iscsi {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.trace_flags = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.unique_fqdn_network = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.use_chap_auth = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volume_backend_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volume_clear = zero {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volume_clear_ionice = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volume_clear_size = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_reports.file_event_handler = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_reports.log_dir = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.backend_availability_zone = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.backend_host = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.chap_password = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.chap_username = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.chiscsi_conf = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.disk_geometry = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.driver_client_cert = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.driver_data_namespace = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.driver_use_ssl = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.extra_capabilities = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.filter_function = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.goodness_function = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.iser_helper = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.iser_ip_address = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.iser_port = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.iser_target_prefix = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_host = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_login = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_mount_options = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_password = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_private_key = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_share_path = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_ssh_port = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.num_shell_tries = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.nvmet_port_id = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.replication_device = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.report_discard_supported = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.reserved_percentage = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.scst_target_driver = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.storage_protocol = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.target_helper = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.target_ip_address = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.target_port = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.target_prefix = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.target_protocol = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.trace_flags = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.use_chap_auth = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volume_clear = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volume_clear_size = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] QuobyteHD.volumes_dir = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.ssl = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_notifications.driver = [] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_notifications.retry = -1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] key_manager.fixed_key = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.barbican_api_version = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.barbican_endpoint = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.barbican_endpoint_type = public {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.barbican_region_name = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.cafile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.certfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.collect_timing = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.insecure = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.keyfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.number_of_retries = 60 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.retry_delay = 1 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.send_service_user_token = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.split_loggers = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.timeout = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.verify_ssl = True {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican.verify_ssl_path = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.auth_section = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.auth_type = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.cafile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.certfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.collect_timing = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.insecure = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.keyfile = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.split_loggers = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] barbican_service_user.timeout = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.approle_role_id = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.approle_secret_id = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.auth_method = approle {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.auth_path = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.kv_mountpoint = secret {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.kv_path = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.kv_version = 2 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.namespace = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.root_token_id = **** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.ssl_ca_crt_file = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.timeout = 60.0 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.token_file = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.token_role = None {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.use_ssl = False {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:39:13 devstack cinder-volume[86925]: DEBUG oslo_service.backend._eventlet.service [None req-d1e84887-ce5c-4c4f-a309-7efaf182cd37 None None] ******************************************************************************** {{(pid=86925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 18:39:14 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.625s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:14 devstack cinder-volume[87167]: INFO cinder.volume.driver [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG cinder.volume.driver [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87167) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG oslo_db.sqlalchemy.engines [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writer thread running {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG cinder.db.api [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Building query based on filter {{(pid=87167) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87167) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:14 devstack cinder-volume[87167]: INFO cinder.keymgr.migration [None req-dc4de552-c1e6-4a43-bd51-6267c0c19547 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 18:39:14 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:39:14 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:15 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.609s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:39:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Driver initialization completed successfully. Jul 11 18:39:15 devstack cinder-volume[87167]: INFO cinder.manager [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Initiating service 3 cleanup Jul 11 18:39:15 devstack cinder-volume[87167]: INFO cinder.manager [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Service 3 cleanup completed. Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG cinder.service [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Creating RPC server for service cinder-volume {{(pid=87167) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG cinder.service [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87167) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 18:39:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:15 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:39:15 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:15 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8c0376f3-bf63-4b63-a3dd-c74c252628c5 None None] Driver post RPC initialization completed successfully. Jul 11 18:39:23 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:39:25 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:39:26 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:40:12 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:40:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Flow 'volume_create_manager' (92a7ca05-c9cb-40df-8041-4928ef6c5c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3900cf-fe8a-4c96-8ab3-8c38baa6bbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3900cf-fe8a-4c96-8ab3-8c38baa6bbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-305183641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9d717d-cbc6-4f94-8ac9-af2e71831b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62faf4cc9f5d4e088c985dce1879b139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:13Z,use_quota=True,user_id='3ca84a3c109e49b98a04f90fc63c0b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a926627-0092-4373-a9f4-1003f28ac178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a926627-0092-4373-a9f4-1003f28ac178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8b25b3-c65e-46a1-9f1c-39c08b68de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8b25b3-c65e-46a1-9f1c-39c08b68de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9d717d-cbc6-4f94-8ac9-af2e71831b4a', 'volume_name': 'volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad4c445-2aa6-43cd-b51c-74540a5fdcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad4c445-2aa6-43cd-b51c-74540a5fdcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03f4338-4bad-4650-9f35-2db9b418bf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Volume 3f9d717d-cbc6-4f94-8ac9-af2e71831b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a', 'volume_size': 1} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-305183641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9d717d-cbc6-4f94-8ac9-af2e71831b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62faf4cc9f5d4e088c985dce1879b139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:13Z,use_quota=True,user_id='3ca84a3c109e49b98a04f90fc63c0b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Creating volume 3f9d717d-cbc6-4f94-8ac9-af2e71831b4a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:40:13 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:40:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:13 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a 1073741824 Jul 11 18:40:13 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:15 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a 1073741824" returned: 0 in 1.898s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:15 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:40:15 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:15 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a Jul 11 18:40:15 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:16 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.960s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 6 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:40:17 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a" returned: 0 in 2.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] <== create_volume: return (4153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.160s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03f4338-4bad-4650-9f35-2db9b418bf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecc87c5-13c0-4fd9-9702-35f7247f5ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Volume volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a (3f9d717d-cbc6-4f94-8ac9-af2e71831b4a): created successfully Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecc87c5-13c0-4fd9-9702-35f7247f5ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Flow 'volume_create_manager' (92a7ca05-c9cb-40df-8041-4928ef6c5c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c82e1ae9-6aa0-426c-a1eb-c44399ca27fb tempest-TaggedAttachmentsTest-1652779733 None] Created volume successfully. Jul 11 18:40:27 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:40:27 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Flow 'volume_create_manager' (8d86e2aa-570f-4fec-be51-9c8a72117b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1223a5e7-b9c2-46ae-a94d-a0f8be261989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1223a5e7-b9c2-46ae-a94d-a0f8be261989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1681229158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05a67980bb54260866a3f336550ea60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:45Z,use_quota=True,user_id='d7026398ffc94030940a3ced19a7ea53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565d0960-29ae-4d92-8ef8-d25220a94ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565d0960-29ae-4d92-8ef8-d25220a94ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338fb01e-4f14-4be4-abac-958712d3212d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338fb01e-4f14-4be4-abac-958712d3212d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03', 'volume_name': 'volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26faec4-5566-436a-a52b-da9e940e090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26faec4-5566-436a-a52b-da9e940e090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711e9fc7-00be-416a-be76-c70c02829d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Volume 48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03', 'volume_size': 1} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1681229158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05a67980bb54260866a3f336550ea60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:45Z,use_quota=True,user_id='d7026398ffc94030940a3ced19a7ea53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Creating volume 48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:40:45 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:40:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:45 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 1073741824 Jul 11 18:40:45 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:46 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 1073741824" returned: 0 in 1.185s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:46 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 Jul 11 18:40:46 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:47 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03" returned: 0 in 1.173s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] <== create_volume: return (2437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:40:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.444s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711e9fc7-00be-416a-be76-c70c02829d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebf2321-410a-41c9-b174-05ed723ab8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Volume volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 (48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03): created successfully Jul 11 18:40:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebf2321-410a-41c9-b174-05ed723ab8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Flow 'volume_create_manager' (8d86e2aa-570f-4fec-be51-9c8a72117b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-239eb88c-b7ba-4626-b27f-fc2c1ec420c1 tempest-ServerRescueNegativeTestJSON-1828033297 None] Created volume successfully. Jul 11 18:40:54 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Flow 'volume_create_manager' (77f3de6e-a930-427c-b659-55cc7ea7b189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2d02e1-d6c0-4538-a652-086faf672e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2d02e1-d6c0-4538-a652-086faf672e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-54942021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66f934d-8d4e-4a87-9c2a-01d22cf73bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e6019f7da4c398f162fc787742ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:55Z,use_quota=True,user_id='007e565c577c476795d6aba3590b9a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15962191-a854-4b51-8e74-c056bc1e8f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15962191-a854-4b51-8e74-c056bc1e8f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629c420c-fd08-4fd2-9dfc-404f015d2e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629c420c-fd08-4fd2-9dfc-404f015d2e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66f934d-8d4e-4a87-9c2a-01d22cf73bb9', 'volume_name': 'volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fc3653-66eb-4740-a35e-2b4948032cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fc3653-66eb-4740-a35e-2b4948032cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512ce069-e5b1-4518-a8b9-028952204bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Volume d66f934d-8d4e-4a87-9c2a-01d22cf73bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9', 'volume_size': 1} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-54942021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66f934d-8d4e-4a87-9c2a-01d22cf73bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e6019f7da4c398f162fc787742ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:55Z,use_quota=True,user_id='007e565c577c476795d6aba3590b9a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Creating volume d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:40:55 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:40:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:55 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 1073741824 Jul 11 18:40:55 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:56 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 1073741824" returned: 0 in 1.880s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:57 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 Jul 11 18:40:57 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:57 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9" returned: 0 in 0.757s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] <== create_volume: return (2703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:40:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.706s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512ce069-e5b1-4518-a8b9-028952204bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02eb96f4-71c4-44e4-979a-e6d8cc6537a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Volume volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 (d66f934d-8d4e-4a87-9c2a-01d22cf73bb9): created successfully Jul 11 18:40:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02eb96f4-71c4-44e4-979a-e6d8cc6537a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Flow 'volume_create_manager' (77f3de6e-a930-427c-b659-55cc7ea7b189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3e25f9dc-dbd5-4661-a9dd-ac6b5e6a2565 tempest-ServersNegativeTestJSON-587319306 None] Created volume successfully. Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Flow 'volume_create_manager' (b7d4de11-56a5-4c33-a029-294e5ae05dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3413163-cab2-4eb7-911a-a9a1bbf63582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3413163-cab2-4eb7-911a-a9a1bbf63582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-339423328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f08f7a3-a257-4408-a6d2-8caeeb5fecdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e6019f7da4c398f162fc787742ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:00Z,use_quota=True,user_id='007e565c577c476795d6aba3590b9a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c249302-a464-4da1-b97e-de481d24d2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c249302-a464-4da1-b97e-de481d24d2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79cc8a19-1b1e-4775-b50d-892bec1f2031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79cc8a19-1b1e-4775-b50d-892bec1f2031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f08f7a3-a257-4408-a6d2-8caeeb5fecdd', 'volume_name': 'volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba89cee-f849-4be3-a5ec-3cb5c9a0e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba89cee-f849-4be3-a5ec-3cb5c9a0e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5807b8-fc59-411f-b5ac-4fc4659c2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Volume 3f08f7a3-a257-4408-a6d2-8caeeb5fecdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd', 'volume_size': 1} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-339423328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f08f7a3-a257-4408-a6d2-8caeeb5fecdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e6019f7da4c398f162fc787742ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:00Z,use_quota=True,user_id='007e565c577c476795d6aba3590b9a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Creating volume 3f08f7a3-a257-4408-a6d2-8caeeb5fecdd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:00 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:41:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:00 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd 1073741824 Jul 11 18:41:00 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:01 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd 1073741824" returned: 0 in 1.015s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:01 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd Jul 11 18:41:01 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:02 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd" returned: 0 in 0.855s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5807b8-fc59-411f-b5ac-4fc4659c2b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3990f6c2-2ff5-4d79-a887-6b0314981919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Volume volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd (3f08f7a3-a257-4408-a6d2-8caeeb5fecdd): created successfully Jul 11 18:41:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3990f6c2-2ff5-4d79-a887-6b0314981919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Flow 'volume_create_manager' (b7d4de11-56a5-4c33-a029-294e5ae05dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-189acbf6-4c1f-4433-accc-cd10a7e88a7a tempest-ServersNegativeTestJSON-587319306 None] Created volume successfully. Jul 11 18:41:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "cinder-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Lock "cinder-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "cinder-quobyte-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Lock "cinder-quobyte-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd" acquired by "delete_volume" :: waited 0.043s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:04 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppeiwslrk/privsep.sock'] Jul 11 18:41:04 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppeiwslrk/privsep.sock Jul 11 18:41:04 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 18:41:05 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 18:41:07 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 11 18:41:07 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:07 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Spawned new privsep daemon via rootwrap Jul 11 18:41:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Accepted privsep connection to /tmp/tmppeiwslrk/privsep.sock {{(pid=87167) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 11 18:41:07 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 11 18:41:07 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 11 18:41:07 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 11 18:41:07 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88535 Jul 11 18:41:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c89a6bd-977f-4a48-8d34-1ee6f13286d1]: (2,) {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47bf55b-120c-4c59-8b0c-2cea83ca2bed]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:07 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd Jul 11 18:41:07 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:08 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd" returned: 0 in 1.291s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:09 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd Jul 11 18:41:09 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:09 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd" returned: 0 in 0.866s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Lock "cinder-quobyte-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd" released by "delete_volume" :: held 5.356s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:09 devstack cinder-volume[87167]: WARNING cinder.quota [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:41:09 devstack cinder-volume[87167]: WARNING cinder.quota [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Created reservations ['1fa15886-2414-4b14-a157-bcb28b007a5e', '627bfc5e-8744-4edd-ad27-fd860e99dc13', '6a7061b9-73f6-470d-8f20-fbdb461a68a3', '4a19000a-0a91-4967-974d-c189fd7bf078'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:10 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:41:10 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "cinder-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Lock "cinder-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "cinder-quobyte-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Acquiring lock "cinder-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Lock "cinder-quobyte-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9" acquired by "delete_volume" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "cinder-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf06be6-bcaa-4523-95cc-21139400017b]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Acquiring lock "cinder-quobyte-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "cinder-quobyte-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[af395d92-ebf6-4112-974a-3565db9a0474]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:10 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 Jul 11 18:41:10 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:11 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 Jul 11 18:41:11 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:11 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.407s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Deleted volume successfully. Jul 11 18:41:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc4fa5d7-a604-411e-b7f3-d21ab422336b tempest-ServersNegativeTestJSON-587319306 None] Lock "cinder-3f08f7a3-a257-4408-a6d2-8caeeb5fecdd-delete_volume" released by "delete_volume" :: held 7.279s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:12 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03" returned: 0 in 1.466s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:12 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9" returned: 0 in 1.628s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:12 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03 Jul 11 18:41:12 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:12 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9 Jul 11 18:41:12 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:13 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9" returned: 0 in 0.953s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:13 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03" returned: 0 in 0.995s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Lock "cinder-quobyte-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9" released by "delete_volume" :: held 2.704s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "cinder-quobyte-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03" released by "delete_volume" :: held 2.540s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Created reservations ['3fd2872e-6626-45a5-a716-519170bece41', 'cfbef5bb-2ca6-434c-90e4-1a0a4c3db873', '692f494f-d172-420b-aa3e-543d58a929de', '9e8332d3-094b-4102-88ba-3e9191fc6059'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Created reservations ['180ca15b-e426-4964-8e40-b62e70b4ca12', 'b2075470-f241-4524-b870-7ec25220e27c', 'ffbd5732-c438-4c25-a219-1c2c9df98d27', '292c323c-8024-4ded-9df8-fd4f1e9054fc'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:13 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:13 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:13 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:41:13 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:14 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.003s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Deleted volume successfully. Jul 11 18:41:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3664e081-9e90-459f-a77f-a92f180b35cb tempest-ServerRescueNegativeTestJSON-1828033297 None] Lock "cinder-48d637b8-a2f3-4c7d-b5d1-8b1fecbf0e03-delete_volume" released by "delete_volume" :: held 4.140s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:15 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:41:15 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:15 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 2.005s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Deleted volume successfully. Jul 11 18:41:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9448b19b-e126-44fe-aa51-237003d7917c tempest-ServersNegativeTestJSON-587319306 None] Lock "cinder-d66f934d-8d4e-4a87-9c2a-01d22cf73bb9-delete_volume" released by "delete_volume" :: held 5.221s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:16 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.460s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:26 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=17,cinder:UPDATE=34,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:41:26 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=33,cinder:SELECT=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Flow 'volume_create_manager' (00036d5a-c4e6-4647-8753-77699a511189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7131e8-ab6d-4f05-9355-914750ed9f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7131e8-ab6d-4f05-9355-914750ed9f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-371994202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852cff76-8c21-4b18-a770-7009d9b91286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed760f1ff2746d4bda2bc79c2f4f0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:35Z,use_quota=True,user_id='1f4e1787db2e4f9eaa01ca222800d41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57942185-7c43-4cef-a754-37d78b58d095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57942185-7c43-4cef-a754-37d78b58d095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc7e39d-fcad-4613-9401-da5497880e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc7e39d-fcad-4613-9401-da5497880e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852cff76-8c21-4b18-a770-7009d9b91286', 'volume_name': 'volume-852cff76-8c21-4b18-a770-7009d9b91286', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d47e52-d6ba-4295-a2dd-bed60f2edcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d47e52-d6ba-4295-a2dd-bed60f2edcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38e2374-df43-4c8c-9176-4d2be19278f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Volume 852cff76-8c21-4b18-a770-7009d9b91286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852cff76-8c21-4b18-a770-7009d9b91286', 'volume_size': 1} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-371994202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852cff76-8c21-4b18-a770-7009d9b91286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed760f1ff2746d4bda2bc79c2f4f0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:35Z,use_quota=True,user_id='1f4e1787db2e4f9eaa01ca222800d41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Creating volume 852cff76-8c21-4b18-a770-7009d9b91286 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:35 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:41:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:35 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 1073741824 Jul 11 18:41:35 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:36 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 1073741824" returned: 0 in 1.128s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:36 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 Jul 11 18:41:36 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:37 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286" returned: 0 in 0.832s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38e2374-df43-4c8c-9176-4d2be19278f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852cff76-8c21-4b18-a770-7009d9b91286', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95e2c5a-72ab-4b3a-849b-89fb91269acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:37 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Volume volume-852cff76-8c21-4b18-a770-7009d9b91286 (852cff76-8c21-4b18-a770-7009d9b91286): created successfully Jul 11 18:41:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95e2c5a-72ab-4b3a-849b-89fb91269acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Flow 'volume_create_manager' (00036d5a-c4e6-4647-8753-77699a511189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-a2d9b74d-4e90-4b60-995c-3f63b9305918 req-a2ba956d-78f3-456e-a365-7a1f917e63e6 tempest-VolumesSnapshotsTestJSON-1728385389 None] Created volume successfully. Jul 11 18:41:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Creating offline snapshot d8890640-c7bb-4358-bbce-49e995b34f0c of volume 852cff76-8c21-4b18-a770-7009d9b91286 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:41:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93f33c3-17b0-4dbd-9c50-62ae828f6e03]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:38 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 Jul 11 18:41:38 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:39 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286" returned: 0 in 0.969s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:39 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c 1G Jul 11 18:41:39 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:40 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c 1G" returned: 0 in 1.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852cff76-8c21-4b18-a770-7009d9b91286 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:40 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852cff76-8c21-4b18-a770-7009d9b91286 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c Jul 11 18:41:40 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:41 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852cff76-8c21-4b18-a770-7009d9b91286 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c" returned: 0 in 0.872s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:41 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c is being set with open permissions: ugo+rw Jul 11 18:41:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:41 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c Jul 11 18:41:41 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:42 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c" returned: 0 in 0.789s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:42 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.info Jul 11 18:41:42 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:42 devstack cinder-volume[87167]: WARNING py.warnings [req-593f4071-fe9e-4911-ab8e-32f83d819005 req-4095b56a-9526-468c-b12a-138790ff162b tempest-TaggedAttachmentsTest-1652779733 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 11 18:41:42 devstack cinder-volume[87167]: .first() Jul 11 18:41:42 devstack cinder-volume[87167]: Jul 11 18:41:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-593f4071-fe9e-4911-ab8e-32f83d819005 req-4095b56a-9526-468c-b12a-138790ff162b tempest-TaggedAttachmentsTest-1652779733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:43 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.info" returned: 0 in 0.792s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:43 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.info is being set with open permissions: ugo+rw Jul 11 18:41:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:43 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.info Jul 11 18:41:43 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:43 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.info" returned: 0 in 0.873s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.466s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-593f4071-fe9e-4911-ab8e-32f83d819005 req-4095b56a-9526-468c-b12a-138790ff162b tempest-TaggedAttachmentsTest-1652779733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.338s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bb7669-5902-4df6-a78b-d15b04b23646]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-593f4071-fe9e-4911-ab8e-32f83d819005 req-4095b56a-9526-468c-b12a-138790ff162b tempest-TaggedAttachmentsTest-1652779733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-81ba4bbf-a1df-4204-8815-1ee03b0da36f req-51c5e52f-c1e9-4b17-955b-cad87e2efb34 tempest-VolumesSnapshotsTestJSON-1728385389 None] Create snapshot completed successfully Jul 11 18:41:44 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a Jul 11 18:41:44 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "cinder-d8890640-c7bb-4358-bbce-49e995b34f0c-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-d8890640-c7bb-4358-bbce-49e995b34f0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "cinder-quobyte-852cff76-8c21-4b18-a770-7009d9b91286" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-quobyte-852cff76-8c21-4b18-a770-7009d9b91286" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "cinder-quobyte-d8890640-c7bb-4358-bbce-49e995b34f0c" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-quobyte-d8890640-c7bb-4358-bbce-49e995b34f0c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Deleting offline snapshot d8890640-c7bb-4358-bbce-49e995b34f0c of volume 852cff76-8c21-4b18-a770-7009d9b91286 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] snapshot_file for this snap is: volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dd6b3e-f2ba-4fd3-933f-f795132e3713]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:44 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c Jul 11 18:41:44 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:45 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-593f4071-fe9e-4911-ab8e-32f83d819005 req-4095b56a-9526-468c-b12a-138790ff162b tempest-TaggedAttachmentsTest-1652779733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a" returned: 0 in 1.256s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-593f4071-fe9e-4911-ab8e-32f83d819005 req-4095b56a-9526-468c-b12a-138790ff162b tempest-TaggedAttachmentsTest-1652779733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.301s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-593f4071-fe9e-4911-ab8e-32f83d819005 req-4095b56a-9526-468c-b12a-138790ff162b tempest-TaggedAttachmentsTest-1652779733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b849bd4d-9cdf-49db-9892-cfdffc50c393', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:41:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-593f4071-fe9e-4911-ab8e-32f83d819005 req-4095b56a-9526-468c-b12a-138790ff162b tempest-TaggedAttachmentsTest-1652779733 None] attachment_update completed successfully. Jul 11 18:41:45 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c" returned: 0 in 1.081s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852cff76-8c21-4b18-a770-7009d9b91286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:41:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23116bf-e33f-4cc1-8a94-0567c9de0ce4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:45 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 Jul 11 18:41:45 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Flow 'volume_create_manager' (a40a8e38-0bb3-4dc9-9852-ce8f9fffb07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6e62d1-2615-4c7c-bffe-3a115a2c387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6e62d1-2615-4c7c-bffe-3a115a2c387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1783173542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267022c4-3954-4451-923a-e0ba5202e11a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f56684189a6846e9af4e205aae711610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:46Z,use_quota=True,user_id='31e1c87296134f5ab15a0e2bf176a86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ad4261-2a43-4ac9-a156-8d47f4e662fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ad4261-2a43-4ac9-a156-8d47f4e662fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964f6502-85fc-49aa-9144-2b8a9f3da759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964f6502-85fc-49aa-9144-2b8a9f3da759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267022c4-3954-4451-923a-e0ba5202e11a', 'volume_name': 'volume-267022c4-3954-4451-923a-e0ba5202e11a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9e0cfa-be84-4f7f-ae4b-cdc61fed4cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9e0cfa-be84-4f7f-ae4b-cdc61fed4cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b320f18-f566-4ec0-afc8-9fbec905510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Volume 267022c4-3954-4451-923a-e0ba5202e11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267022c4-3954-4451-923a-e0ba5202e11a', 'volume_size': 1} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1783173542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267022c4-3954-4451-923a-e0ba5202e11a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f56684189a6846e9af4e205aae711610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:46Z,use_quota=True,user_id='31e1c87296134f5ab15a0e2bf176a86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Creating volume 267022c4-3954-4451-923a-e0ba5202e11a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:46 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:46 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a 1073741824 Jul 11 18:41:46 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:46 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286" returned: 0 in 0.900s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:46 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c Jul 11 18:41:46 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:47 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:47 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c" returned: 0 in 0.846s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a 1073741824" returned: 0 in 0.987s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:47 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c Jul 11 18:41:47 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:47 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a Jul 11 18:41:47 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:48 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286.d8890640-c7bb-4358-bbce-49e995b34f0c" returned: 0 in 0.704s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:48 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a" returned: 0 in 0.693s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-quobyte-d8890640-c7bb-4358-bbce-49e995b34f0c" released by "_delete_snapshot" :: held 3.701s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b320f18-f566-4ec0-afc8-9fbec905510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267022c4-3954-4451-923a-e0ba5202e11a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2580a7-63ce-4e91-8e39-cc39c1da51b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-quobyte-852cff76-8c21-4b18-a770-7009d9b91286" released by "delete_snapshot" :: held 3.747s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Volume volume-267022c4-3954-4451-923a-e0ba5202e11a (267022c4-3954-4451-923a-e0ba5202e11a): created successfully Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2580a7-63ce-4e91-8e39-cc39c1da51b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Flow 'volume_create_manager' (a40a8e38-0bb3-4dc9-9852-ce8f9fffb07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-eb80574e-5e60-46f6-b3ca-7a1f245b3369 req-e3364146-2d58-4011-9bd3-b68bea88b47d tempest-VolumesGetTestJSON-2123655909 None] Created volume successfully. Jul 11 18:41:48 devstack cinder-volume[87167]: WARNING cinder.quota [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.quota [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Created reservations ['0f502445-0fdc-4dd3-b577-69ab1f934826', '926bac3c-c619-4eb3-9192-e85cd98838e7', 'f2479f41-7db2-4f22-80f2-343a88ee6cb1', '3ba7537a-6376-4312-a06c-7dcbc01bbe1e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Delete snapshot completed successfully. Jul 11 18:41:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-5a1a96b3-468e-4204-bbf5-71fd68fb64cc req-46da7a8a-01e9-414b-8000-a4c823aabc9f tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-d8890640-c7bb-4358-bbce-49e995b34f0c-delete_snapshot" released by "delete_snapshot" :: held 3.905s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Acquiring lock "cinder-267022c4-3954-4451-923a-e0ba5202e11a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Lock "cinder-267022c4-3954-4451-923a-e0ba5202e11a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Acquiring lock "cinder-quobyte-267022c4-3954-4451-923a-e0ba5202e11a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Lock "cinder-quobyte-267022c4-3954-4451-923a-e0ba5202e11a" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5032bee0-bf46-4aaf-949f-7d2f003a75e1]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "cinder-852cff76-8c21-4b18-a770-7009d9b91286-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-852cff76-8c21-4b18-a770-7009d9b91286-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "cinder-quobyte-852cff76-8c21-4b18-a770-7009d9b91286" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:49 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a Jul 11 18:41:49 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-quobyte-852cff76-8c21-4b18-a770-7009d9b91286" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b05837-238d-4eb4-a22a-18e48af9d472]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:49 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 Jul 11 18:41:49 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:50 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a" returned: 0 in 1.081s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:50 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a Jul 11 18:41:50 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:50 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286" returned: 0 in 1.008s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:50 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286 Jul 11 18:41:50 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:51 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-267022c4-3954-4451-923a-e0ba5202e11a" returned: 0 in 0.832s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Lock "cinder-quobyte-267022c4-3954-4451-923a-e0ba5202e11a" released by "delete_volume" :: held 1.989s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG cinder.quota [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Created reservations ['da1455cf-4e5c-4226-a11c-9ba533e18d43', '78c8f44d-5107-428e-bbbb-81af84716756', '05f04380-492f-4682-a2eb-e5c198dccd3d', 'f8dcd65a-d859-4d5c-a498-ccfad5b7571a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:51 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:41:51 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:51 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-852cff76-8c21-4b18-a770-7009d9b91286" returned: 0 in 0.855s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-quobyte-852cff76-8c21-4b18-a770-7009d9b91286" released by "delete_volume" :: held 1.960s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG cinder.quota [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Created reservations ['7f3a53cb-671c-403a-9858-616e82606eeb', 'b1241dc9-4b3e-4f34-8149-9e1c10e97f50', 'fc3c327b-6d87-4055-ab86-4e2b77429639', 'cd5962ef-b471-4419-8d6f-7150afb1b906'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:51 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:41:51 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:52 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.447s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:52 devstack cinder-volume[87167]: DEBUG cinder.manager [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Deleted volume successfully. Jul 11 18:41:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-98245f48-4a84-4416-a97a-aff7b10b45c3 req-89f630e6-aea8-4d73-b946-00b62fbd09be tempest-VolumesGetTestJSON-2123655909 None] Lock "cinder-267022c4-3954-4451-923a-e0ba5202e11a-delete_volume" released by "delete_volume" :: held 3.759s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:52 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.303s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:53 devstack cinder-volume[87167]: DEBUG cinder.manager [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Deleted volume successfully. Jul 11 18:41:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-09aa243e-ffd4-48d0-a889-cc48181eb5eb req-1a8ef1df-813d-49c4-8a7e-0b6ae3621071 tempest-VolumesSnapshotsTestJSON-1728385389 None] Lock "cinder-852cff76-8c21-4b18-a770-7009d9b91286-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-06aa6a52-35e0-42ec-9c84-622ea08e3043 req-8be6aa57-d5e0-4137-96a4-4e6f105db35f tempest-TaggedAttachmentsTest-1652779733 None] Terminate volume connection completed successfully. Jul 11 18:41:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-06aa6a52-35e0-42ec-9c84-622ea08e3043 req-8be6aa57-d5e0-4137-96a4-4e6f105db35f tempest-TaggedAttachmentsTest-1652779733 None] Deleting attachment b849bd4d-9cdf-49db-9892-cfdffc50c393. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Flow 'volume_create_manager' (69d96e23-5f94-4889-b58c-3b064d8d7331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45e553d-da51-40af-851e-4e4b55025b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45e553d-da51-40af-851e-4e4b55025b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-238363192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f8212b-2131-46a6-83b1-8ad2a4af520b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09227f26844442e96e8c136d4a694be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:55Z,use_quota=True,user_id='940fc28f50de435caea97c39c53759de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72966e34-0549-4d9d-8697-64118cebfe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72966e34-0549-4d9d-8697-64118cebfe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c2adc9-64d6-4764-a25b-b656e5ed7b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c2adc9-64d6-4764-a25b-b656e5ed7b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f8212b-2131-46a6-83b1-8ad2a4af520b', 'volume_name': 'volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83050c04-2f22-446c-91e7-14558ed0d5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83050c04-2f22-446c-91e7-14558ed0d5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96e85d2-c591-486f-be77-79d2fc2ef349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Volume a5f8212b-2131-46a6-83b1-8ad2a4af520b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b', 'volume_size': 1} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-238363192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f8212b-2131-46a6-83b1-8ad2a4af520b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09227f26844442e96e8c136d4a694be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:55Z,use_quota=True,user_id='940fc28f50de435caea97c39c53759de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Creating volume a5f8212b-2131-46a6-83b1-8ad2a4af520b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:55 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:41:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:55 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b 1073741824 Jul 11 18:41:55 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:56 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b 1073741824" returned: 0 in 1.418s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:57 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b Jul 11 18:41:57 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:57 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b" returned: 0 in 0.936s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] <== create_volume: return (2437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.439s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96e85d2-c591-486f-be77-79d2fc2ef349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e77434-eaa1-4523-9770-103e7e5029f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Volume volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b (a5f8212b-2131-46a6-83b1-8ad2a4af520b): created successfully Jul 11 18:41:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e77434-eaa1-4523-9770-103e7e5029f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Flow 'volume_create_manager' (69d96e23-5f94-4889-b58c-3b064d8d7331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0e17371f-ac42-4da6-b48a-249f032286ba tempest-VolumesAdminNegativeTest-1649408825 None] Created volume successfully. Jul 11 18:41:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2f0cdc67-45e9-4b7c-be79-0e66527e6942 tempest-GroupSnapshotsTest-797082451 None] Group tempest-GroupSnapshotsTest-Group-733698462: creating Jul 11 18:41:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2f0cdc67-45e9-4b7c-be79-0e66527e6942 tempest-GroupSnapshotsTest-797082451 None] Group tempest-GroupSnapshotsTest-Group-733698462: created successfully Jul 11 18:41:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2f0cdc67-45e9-4b7c-be79-0e66527e6942 tempest-GroupSnapshotsTest-797082451 None] Create group completed successfully. Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Flow 'volume_create_manager' (a6be2e68-f479-4809-b89c-367c9ecb5a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afa80fa-f7a1-48ed-80ec-4b1ab8fda958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afa80fa-f7a1-48ed-80ec-4b1ab8fda958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-221356543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0b0580-1236-4157-8dae-e731aec35353,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88da90201cc54487bd1b04a87acea681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:59Z,use_quota=True,user_id='ead3a11479e34305a65ba2b6accd6dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f72a09-0c5e-40e5-a4d9-089a502d168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f72a09-0c5e-40e5-a4d9-089a502d168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b8786d-5c30-4ea0-bc39-6dd049307829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b8786d-5c30-4ea0-bc39-6dd049307829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0b0580-1236-4157-8dae-e731aec35353', 'volume_name': 'volume-5d0b0580-1236-4157-8dae-e731aec35353', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919be16b-869a-4d54-97de-66c0c600e7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919be16b-869a-4d54-97de-66c0c600e7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb512cce-f452-4350-8b34-139d249d7c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Volume 5d0b0580-1236-4157-8dae-e731aec35353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0b0580-1236-4157-8dae-e731aec35353', 'volume_size': 1} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-221356543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0b0580-1236-4157-8dae-e731aec35353,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88da90201cc54487bd1b04a87acea681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:59Z,use_quota=True,user_id='ead3a11479e34305a65ba2b6accd6dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Creating volume 5d0b0580-1236-4157-8dae-e731aec35353 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:59 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:59 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 1073741824 Jul 11 18:41:59 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Acquiring lock "cinder-a5f8212b-2131-46a6-83b1-8ad2a4af520b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Lock "cinder-a5f8212b-2131-46a6-83b1-8ad2a4af520b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Acquiring lock "cinder-quobyte-a5f8212b-2131-46a6-83b1-8ad2a4af520b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Lock "cinder-quobyte-a5f8212b-2131-46a6-83b1-8ad2a4af520b" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[29608b0e-85c0-473a-8f81-f3a556e2b1ad]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:59 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b Jul 11 18:41:59 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:00 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 1073741824" returned: 0 in 1.184s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:00 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b" returned: 0 in 0.971s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:00 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b Jul 11 18:42:00 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:00 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 Jul 11 18:42:00 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Flow 'volume_create_manager' (dd18fc82-0a37-49f1-8914-346091e087eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527e0f86-0c2d-4f1a-84f2-3f7712b67d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527e0f86-0c2d-4f1a-84f2-3f7712b67d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-792733499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a26cbf54-1b41-4faf-bf9a-251fb372c0a2,host='devstack@QuobyteHD#QuobyteHD',id=386ea7d6-573e-48cd-b493-cb4d4fded260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd8ac3b4c84f9685b101ed2284960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:01Z,use_quota=True,user_id='0770a3a31f6b46f0a7370e3e4d5f4b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63499685-5f54-454e-848b-bf4e8d603e85),volume_type_id=63499685-5f54-454e-848b-bf4e8d603e85)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2a837-c577-4337-9e98-4eed7989f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2a837-c577-4337-9e98-4eed7989f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40453bac-49c3-44ea-9945-204e34acbb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40453bac-49c3-44ea-9945-204e34acbb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386ea7d6-573e-48cd-b493-cb4d4fded260', 'volume_name': 'volume-386ea7d6-573e-48cd-b493-cb4d4fded260', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17768c64-a714-4aa7-b182-3653030d1328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17768c64-a714-4aa7-b182-3653030d1328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1569f007-c2a5-4be6-a9c7-80284f5ddd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Volume 386ea7d6-573e-48cd-b493-cb4d4fded260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386ea7d6-573e-48cd-b493-cb4d4fded260', 'volume_size': 1} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:01 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a5f8212b-2131-46a6-83b1-8ad2a4af520b" returned: 0 in 1.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Lock "cinder-quobyte-a5f8212b-2131-46a6-83b1-8ad2a4af520b" released by "delete_volume" :: held 2.029s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:01 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353" returned: 0 in 1.005s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a26cbf54-1b41-4faf-bf9a-251fb372c0a2,created_at=2026-07-11T16:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-792733499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a26cbf54-1b41-4faf-bf9a-251fb372c0a2,host='devstack@QuobyteHD#QuobyteHD',id=386ea7d6-573e-48cd-b493-cb4d4fded260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd8ac3b4c84f9685b101ed2284960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:01Z,use_quota=True,user_id='0770a3a31f6b46f0a7370e3e4d5f4b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63499685-5f54-454e-848b-bf4e8d603e85),volume_type_id=63499685-5f54-454e-848b-bf4e8d603e85)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Creating volume 386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:01 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb512cce-f452-4350-8b34-139d249d7c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0b0580-1236-4157-8dae-e731aec35353', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:01 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 1073741824 Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77baf0dd-06f4-43ca-92ff-91cc3274d583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:01 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Created reservations ['08a05b2e-af51-4c2c-858f-ab76e645981b', '2d204ef3-b171-4b05-b07e-5a839bfa1949', 'bd69e339-6eae-407e-ab41-bbb460728a8e', 'cf8a48b4-b894-4b13-9821-74c45216c493'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Volume volume-5d0b0580-1236-4157-8dae-e731aec35353 (5d0b0580-1236-4157-8dae-e731aec35353): created successfully Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77baf0dd-06f4-43ca-92ff-91cc3274d583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Flow 'volume_create_manager' (a6be2e68-f479-4809-b89c-367c9ecb5a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e0708776-4b10-4c00-9af5-f3a1e60cf322 tempest-VolumesTestJSON-1653481358 None] Created volume successfully. Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:02 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:42:02 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:02 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.827s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:02 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Deleted volume successfully. Jul 11 18:42:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-657097c9-f070-461f-bcb7-03d0dd8f449e tempest-VolumesAdminNegativeTest-1649408825 None] Lock "cinder-a5f8212b-2131-46a6-83b1-8ad2a4af520b-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:02 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 1073741824" returned: 0 in 1.070s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:02 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 Jul 11 18:42:02 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Flow 'volume_create_manager' (1fcc0420-b956-4f08-8148-faadccec3e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e28115b-27b8-44d6-b094-d4534dfd57eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e28115b-27b8-44d6-b094-d4534dfd57eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1278804497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=785dabf8-4aba-45d0-98a8-a8f6cb6ff836,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88da90201cc54487bd1b04a87acea681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:03Z,use_quota=True,user_id='ead3a11479e34305a65ba2b6accd6dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df269e1-5d9a-4320-9572-2502de7256ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df269e1-5d9a-4320-9572-2502de7256ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f45be80-729c-4213-b762-fc4b537f4698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f45be80-729c-4213-b762-fc4b537f4698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '785dabf8-4aba-45d0-98a8-a8f6cb6ff836', 'volume_name': 'volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a296dff-58ec-4f00-bf53-f8e235b141f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a296dff-58ec-4f00-bf53-f8e235b141f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1529436-aa1f-4f9d-9b38-21fb6d82da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Volume 785dabf8-4aba-45d0-98a8-a8f6cb6ff836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836', 'volume_size': 1} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:03 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260" returned: 0 in 1.005s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1278804497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=785dabf8-4aba-45d0-98a8-a8f6cb6ff836,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88da90201cc54487bd1b04a87acea681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:03Z,use_quota=True,user_id='ead3a11479e34305a65ba2b6accd6dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Creating volume 785dabf8-4aba-45d0-98a8-a8f6cb6ff836 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:03 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:42:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:03 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 1073741824 Jul 11 18:42:03 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1569f007-c2a5-4be6-a9c7-80284f5ddd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386ea7d6-573e-48cd-b493-cb4d4fded260', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307748db-4218-4f9d-8e71-a047a57f8025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Volume volume-386ea7d6-573e-48cd-b493-cb4d4fded260 (386ea7d6-573e-48cd-b493-cb4d4fded260): created successfully Jul 11 18:42:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307748db-4218-4f9d-8e71-a047a57f8025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Flow 'volume_create_manager' (dd18fc82-0a37-49f1-8914-346091e087eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-34c92415-442b-4ba3-8b58-816704a78a29 tempest-GroupSnapshotsTest-797082451 None] Created volume successfully. Jul 11 18:42:04 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 1073741824" returned: 0 in 0.905s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:04 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 Jul 11 18:42:04 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] GroupSnapshot 02a88067-877b-40c0-b576-a9659de30fc6: creating. Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Group snapshot 02a88067-877b-40c0-b576-a9659de30fc6: creating. {{(pid=87167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:05 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836" returned: 0 in 0.895s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.275s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Creating offline snapshot 44f42bb4-96cd-4383-8e84-a31d340f0393 of volume 386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1529436-aa1f-4f9d-9b38-21fb6d82da16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8dbbdf-9370-4540-8e2b-37361bc02580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad8030-769c-43be-a43d-53abf1e4a77d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Volume volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 (785dabf8-4aba-45d0-98a8-a8f6cb6ff836): created successfully Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8dbbdf-9370-4540-8e2b-37361bc02580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Flow 'volume_create_manager' (1fcc0420-b956-4f08-8148-faadccec3e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7dc044ef-03c8-4370-9985-b9f7f5bab411 tempest-VolumesTestJSON-1653481358 None] Created volume successfully. Jul 11 18:42:06 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 Jul 11 18:42:06 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:07 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260" returned: 0 in 1.245s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:07 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 1G Jul 11 18:42:07 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Flow 'volume_create_manager' (da9adf54-d746-4265-a988-ab3cae0f3d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7037b1-f1a8-4d9c-b7c5-ce6e1a19bf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7037b1-f1a8-4d9c-b7c5-ce6e1a19bf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1515028332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35681bc-a641-47fe-aa90-ed7380d14553,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88da90201cc54487bd1b04a87acea681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:07Z,use_quota=True,user_id='ead3a11479e34305a65ba2b6accd6dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92734e3e-1523-4b3b-9e1d-6d79bbf88464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92734e3e-1523-4b3b-9e1d-6d79bbf88464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2881fcd-2964-43ab-88fe-6b1d070ca73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2881fcd-2964-43ab-88fe-6b1d070ca73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35681bc-a641-47fe-aa90-ed7380d14553', 'volume_name': 'volume-f35681bc-a641-47fe-aa90-ed7380d14553', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83a19cc-5492-416f-b1f0-8c0daaf44bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83a19cc-5492-416f-b1f0-8c0daaf44bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e489298c-5a18-4d71-829e-4d54dbfd601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Volume f35681bc-a641-47fe-aa90-ed7380d14553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35681bc-a641-47fe-aa90-ed7380d14553', 'volume_size': 1} Jul 11 18:42:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:08 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 1G" returned: 0 in 1.031s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386ea7d6-573e-48cd-b493-cb4d4fded260 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:08 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386ea7d6-573e-48cd-b493-cb4d4fded260 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 Jul 11 18:42:08 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:08 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386ea7d6-573e-48cd-b493-cb4d4fded260 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393" returned: 0 in 0.715s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:08 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:08 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 Jul 11 18:42:08 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:09 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:09 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.info Jul 11 18:42:09 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:10 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.info" returned: 0 in 0.672s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:10 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:10 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.info Jul 11 18:42:10 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:10 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.info" returned: 0 in 0.645s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.058s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.348s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1515028332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35681bc-a641-47fe-aa90-ed7380d14553,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88da90201cc54487bd1b04a87acea681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:07Z,use_quota=True,user_id='ead3a11479e34305a65ba2b6accd6dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Creating volume f35681bc-a641-47fe-aa90-ed7380d14553 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:10 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:42:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:10 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 1073741824 Jul 11 18:42:10 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b52c724f-9f03-4cda-aca9-9dda417ed219 tempest-GroupSnapshotsTest-797082451 None] group_snapshot 02a88067-877b-40c0-b576-a9659de30fc6: created successfully Jul 11 18:42:11 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 1073741824" returned: 0 in 0.873s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:11 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 Jul 11 18:42:11 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:12 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553" returned: 0 in 0.680s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e489298c-5a18-4d71-829e-4d54dbfd601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35681bc-a641-47fe-aa90-ed7380d14553', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724b2865-6188-412a-a21d-c7b8ddbae762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Volume volume-f35681bc-a641-47fe-aa90-ed7380d14553 (f35681bc-a641-47fe-aa90-ed7380d14553): created successfully Jul 11 18:42:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724b2865-6188-412a-a21d-c7b8ddbae762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Flow 'volume_create_manager' (da9adf54-d746-4265-a988-ab3cae0f3d95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9c73c7c7-d48b-46f0-b55f-f46ecdc944ab tempest-VolumesTestJSON-1653481358 None] Created volume successfully. Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-44f42bb4-96cd-4383-8e84-a31d340f0393-93d3b753-b8cb-4706-8dd5-a485b058d5bb" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-44f42bb4-96cd-4383-8e84-a31d340f0393-93d3b753-b8cb-4706-8dd5-a485b058d5bb" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Creating volume 93d3b753-b8cb-4706-8dd5-a485b058d5bb from snapshot 44f42bb4-96cd-4383-8e84-a31d340f0393 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-93d3b753-b8cb-4706-8dd5-a485b058d5bb" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-93d3b753-b8cb-4706-8dd5-a485b058d5bb" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] snapshot: 44f42bb4-96cd-4383-8e84-a31d340f0393, volume: 93d3b753-b8cb-4706-8dd5-a485b058d5bb, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178d138-d4db-4fe9-868c-ba034141a60e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:13 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 Jul 11 18:42:13 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:14 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393" returned: 0 in 1.096s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-386ea7d6-573e-48cd-b493-cb4d4fded260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:42:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:42:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:42:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd8d3d4-5cc3-45f3-8b1c-ae9144885e54]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:14 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 Jul 11 18:42:14 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Acquiring lock "cinder-f35681bc-a641-47fe-aa90-ed7380d14553-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Lock "cinder-f35681bc-a641-47fe-aa90-ed7380d14553-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:15 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:42:15 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Acquiring lock "cinder-quobyte-f35681bc-a641-47fe-aa90-ed7380d14553" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Lock "cinder-quobyte-f35681bc-a641-47fe-aa90-ed7380d14553" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[627b3f80-2702-49ad-9cc4-f7a71413bc2e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Acquiring lock "cinder-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Lock "cinder-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:15 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 Jul 11 18:42:15 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Acquiring lock "cinder-quobyte-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Lock "cinder-quobyte-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d3579e-2c9e-4d96-8b36-1f8805b91497]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:15 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260" returned: 0 in 1.217s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:42:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:15 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb Jul 11 18:42:15 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:15 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a Jul 11 18:42:15 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:16 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.153s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:42:16 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553" returned: 0 in 1.359s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:16 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553 Jul 11 18:42:16 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:16 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a" returned: 0 in 1.088s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:16 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a Jul 11 18:42:16 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:17 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f35681bc-a641-47fe-aa90-ed7380d14553" returned: 0 in 1.356s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Lock "cinder-quobyte-f35681bc-a641-47fe-aa90-ed7380d14553" released by "delete_volume" :: held 2.800s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:18 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a" returned: 0 in 1.405s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Lock "cinder-quobyte-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a" released by "delete_volume" :: held 2.573s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Created reservations ['cb2eb598-df6c-4dd0-915e-d40e0b8bbb6b', 'eb72cff9-0308-4693-a4fc-55a5f1abaa17', '4e60da6b-5a0e-42f4-926f-7136dfc7a603', 'd7288ff7-3c88-4543-afd0-c59b56870102'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Created reservations ['3b70dd4b-cd01-42e0-8f32-76327123f62b', '3e99a9a4-d5f9-4f72-89f7-69bae5e9e367', '08688603-4728-44f6-ab74-be1f6e4a665b', '40e9b84f-f558-447a-a936-a5508bba881a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:18 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:42:18 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "cinder-785dabf8-4aba-45d0-98a8-a8f6cb6ff836-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:18 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:42:18 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Lock "cinder-785dabf8-4aba-45d0-98a8-a8f6cb6ff836-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "cinder-quobyte-785dabf8-4aba-45d0-98a8-a8f6cb6ff836" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Lock "cinder-quobyte-785dabf8-4aba-45d0-98a8-a8f6cb6ff836" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ae76e-8273-44da-bfd5-5e15a6476d2e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:19 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 Jul 11 18:42:19 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:20 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.943s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:20 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Deleted volume successfully. Jul 11 18:42:20 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 2.206s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:20 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Deleted volume successfully. Jul 11 18:42:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-256b4d6e-d297-4310-b96c-f673057840bc tempest-TaggedAttachmentsTest-1652779733 None] Lock "cinder-3f9d717d-cbc6-4f94-8ac9-af2e71831b4a-delete_volume" released by "delete_volume" :: held 5.303s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87600c94-9b16-4d6f-88cb-d0856fb3d73e tempest-VolumesTestJSON-1653481358 None] Lock "cinder-f35681bc-a641-47fe-aa90-ed7380d14553-delete_volume" released by "delete_volume" :: held 5.762s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:21 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836" returned: 0 in 2.761s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:21 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836 Jul 11 18:42:21 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:23 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-785dabf8-4aba-45d0-98a8-a8f6cb6ff836" returned: 0 in 1.525s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Lock "cinder-quobyte-785dabf8-4aba-45d0-98a8-a8f6cb6ff836" released by "delete_volume" :: held 4.423s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Created reservations ['be11f7b9-58b9-43a8-bb1d-aa940f6df15c', '9079e4ad-5676-45e6-a8be-1fb37cec33d9', '343b5a52-35f1-49f6-8dfa-9111730bd247', '360f790f-1c35-4da1-9d7a-31d7794fa345'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:23 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:42:23 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:23 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb" returned: 0 in 8.126s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2327c23-e0a2-4d5b-83e2-fccf06fe73f3]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:23 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 Jul 11 18:42:23 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:24 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.927s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Deleted volume successfully. Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-674b5ed0-aee2-4a0d-a907-1bfd743c6124 tempest-VolumesTestJSON-1653481358 None] Lock "cinder-785dabf8-4aba-45d0-98a8-a8f6cb6ff836-delete_volume" released by "delete_volume" :: held 5.814s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "cinder-5d0b0580-1236-4157-8dae-e731aec35353-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Lock "cinder-5d0b0580-1236-4157-8dae-e731aec35353-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "cinder-quobyte-5d0b0580-1236-4157-8dae-e731aec35353" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Lock "cinder-quobyte-5d0b0580-1236-4157-8dae-e731aec35353" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca662b7-9c6c-4ec1-84a1-7f7abfe778e6]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:24 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:24 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260" returned: 0 in 1.189s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260, size 1024.00 MB, duration 8.13 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:42:24 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:24 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Converted 1024.00 MB image at 125.99 MB/s Jul 11 18:42:24 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:24 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb Jul 11 18:42:24 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:25 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb" returned: 0 in 0.895s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-93d3b753-b8cb-4706-8dd5-a485b058d5bb" released by "_copy_volume_from_snapshot" :: held 12.652s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-44f42bb4-96cd-4383-8e84-a31d340f0393-93d3b753-b8cb-4706-8dd5-a485b058d5bb" released by "_create_volume_from_snapshot" :: held 12.700s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.720s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:25 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353" returned: 0 in 1.133s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:25 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353 Jul 11 18:42:25 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-07fb5544-ac5d-4da9-9bdc-5505922db816 tempest-GroupSnapshotsTest-797082451 None] Create group from source-snapshot-02a88067-877b-40c0-b576-a9659de30fc6 completed successfully. Jul 11 18:42:26 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5d0b0580-1236-4157-8dae-e731aec35353" returned: 0 in 0.777s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Lock "cinder-quobyte-5d0b0580-1236-4157-8dae-e731aec35353" released by "delete_volume" :: held 1.966s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=79,cinder:SELECT=76,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=70,cinder:UPDATE=87,cinder:DELETE=9,cinder:INSERT=17 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Created reservations ['83104a89-719b-40b5-afcf-746586b54383', 'f19321e9-35e1-4ace-b4ac-b07d0199b432', '2ff186cf-39b0-4103-b026-2bc789ba0a86', '8e325957-c70d-440c-a923-0ee32105ab74'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:26 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:42:26 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-93d3b753-b8cb-4706-8dd5-a485b058d5bb" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-93d3b753-b8cb-4706-8dd5-a485b058d5bb" acquired by "delete_volume" :: waited 0.039s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da9352-1d4d-4639-9708-d393f5ab4da2]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:27 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb Jul 11 18:42:27 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:27 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.855s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:27 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Deleted volume successfully. Jul 11 18:42:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a4d5d3a3-f588-4496-9265-b71de83325d8 tempest-VolumesTestJSON-1653481358 None] Lock "cinder-5d0b0580-1236-4157-8dae-e731aec35353-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:28 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb" returned: 0 in 1.220s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:28 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb Jul 11 18:42:28 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:29 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-93d3b753-b8cb-4706-8dd5-a485b058d5bb" returned: 0 in 0.814s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-93d3b753-b8cb-4706-8dd5-a485b058d5bb" released by "delete_volume" :: held 2.105s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Created reservations ['298e1acb-8210-4a41-bd1b-07679dceeaee'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:29 devstack cinder-volume[87167]: WARNING cinder.quota [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1790589457 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1790589457, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:42:29 devstack cinder-volume[87167]: WARNING cinder.quota [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1790589457 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1790589457, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Created reservations ['95343391-72b8-44a0-8bf8-670d90f4a494', '6966c572-64a5-4a79-b3f2-074ea07ee1b7', '43ee2d54-7c29-4f58-bf4f-e1344a4ae1be', 'e1237ccb-3bd5-4b19-b0db-e78c2d8f487c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:29 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:42:29 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] group_snapshot 02a88067-877b-40c0-b576-a9659de30fc6: deleting Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] group_snapshot 02a88067-877b-40c0-b576-a9659de30fc6: deleting {{(pid=87167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-386ea7d6-573e-48cd-b493-cb4d4fded260" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-386ea7d6-573e-48cd-b493-cb4d4fded260" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-44f42bb4-96cd-4383-8e84-a31d340f0393" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-44f42bb4-96cd-4383-8e84-a31d340f0393" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Deleting offline snapshot 44f42bb4-96cd-4383-8e84-a31d340f0393 of volume 386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:42:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] snapshot_file for this snap is: volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:42:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fd9e7b-4f32-4509-9ad2-c6c9e322d81f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:30 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 Jul 11 18:42:30 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:30 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.139s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:30 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1f521a5c-48a6-440f-85b4-0b8b2f907b98 tempest-GroupSnapshotsTest-797082451 None] Delete group completed successfully. Jul 11 18:42:31 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393" returned: 0 in 1.194s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-386ea7d6-573e-48cd-b493-cb4d4fded260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:42:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c279ffa-6a22-42dc-ab7a-d8e4d2dd970f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:31 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 Jul 11 18:42:31 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:32 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260" returned: 0 in 0.959s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:32 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 Jul 11 18:42:32 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:33 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393" returned: 0 in 0.936s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:33 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393 Jul 11 18:42:33 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:34 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260.44f42bb4-96cd-4383-8e84-a31d340f0393" returned: 0 in 0.766s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-44f42bb4-96cd-4383-8e84-a31d340f0393" released by "_delete_snapshot" :: held 4.037s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-386ea7d6-573e-48cd-b493-cb4d4fded260" released by "delete_snapshot" :: held 4.084s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:34 devstack cinder-volume[87167]: WARNING cinder.quota [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1790589457 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1790589457, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:42:34 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] Created reservations ['5281fd8f-44eb-4172-b9a9-8b034f67a1d2', '31ba5efb-b6bc-4e50-9000-5db2cfd13521', 'ef4bda54-a4c0-4262-b841-95722d65254e', '3dff82e1-5c89-4419-aba9-5c29861a6c6b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-40f788a3-dbef-4464-9b4f-9b7652940f15 tempest-GroupSnapshotsTest-797082451 None] group_snapshot 02a88067-877b-40c0-b576-a9659de30fc6: deleted successfully Jul 11 18:42:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-386ea7d6-573e-48cd-b493-cb4d4fded260" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-386ea7d6-573e-48cd-b493-cb4d4fded260" acquired by "delete_volume" :: waited 0.039s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-95f4c9c7-6499-4a53-913c-a80e4fdca83d tempest-BackendsCapabilitiesAdminTestsJSON-1651356318 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 18:42:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab28cce-5837-4604-91e4-22fe5fa58472]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:35 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 Jul 11 18:42:35 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a837fd0e-0287-4842-8aea-ca4238d6e73f tempest-BackendsCapabilitiesAdminTestsJSON-1651356318 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 18:42:35 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260" returned: 0 in 0.917s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:35 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260 Jul 11 18:42:35 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:36 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-386ea7d6-573e-48cd-b493-cb4d4fded260" returned: 0 in 0.889s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-386ea7d6-573e-48cd-b493-cb4d4fded260" released by "delete_volume" :: held 1.888s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Created reservations ['77118c97-f363-47e6-8d65-26511518493c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:36 devstack cinder-volume[87167]: WARNING cinder.db.api [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1790589457'] Jul 11 18:42:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Created reservations ['a50ca834-318b-43ce-ac51-79553723cdb8', '70236085-c50c-451e-b8f3-9702570dcb7c', '649f3d5d-4923-46f3-9e5a-566c936d1be5', '3ac0830a-3f9f-41ae-bf3b-83fb19c3a01e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:37 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:42:37 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:37 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.753s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1e2282ee-1f5a-4ec6-b76f-d9cb2f7e4efa tempest-GroupSnapshotsTest-797082451 None] Delete group completed successfully. Jul 11 18:42:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b1458e2b-1662-4eba-a6e5-cadf531ae189 tempest-GroupSnapshotsTest-797082451 None] Group tempest-GroupSnapshotsTest-Group-549863336: creating Jul 11 18:42:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b1458e2b-1662-4eba-a6e5-cadf531ae189 tempest-GroupSnapshotsTest-797082451 None] Group tempest-GroupSnapshotsTest-Group-549863336: created successfully Jul 11 18:42:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b1458e2b-1662-4eba-a6e5-cadf531ae189 tempest-GroupSnapshotsTest-797082451 None] Create group completed successfully. Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Flow 'volume_create_manager' (dde4e702-a9ae-4db5-8821-671a28a7b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edef22f-1469-4493-b19d-3ceeeb8a8a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edef22f-1469-4493-b19d-3ceeeb8a8a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2121071954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41c52283-1075-473e-bc46-da91b5491538,host='devstack@QuobyteHD#QuobyteHD',id=d47147a2-26a6-45a0-94cc-7f02083b01fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd8ac3b4c84f9685b101ed2284960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:40Z,use_quota=True,user_id='0770a3a31f6b46f0a7370e3e4d5f4b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7938409c-e69a-4313-b8db-f5dd2c9bf578),volume_type_id=7938409c-e69a-4313-b8db-f5dd2c9bf578)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b97a5f-95c2-41db-a749-7feeb0814e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b97a5f-95c2-41db-a749-7feeb0814e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef52d31-1600-4291-8632-682b32f992ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef52d31-1600-4291-8632-682b32f992ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47147a2-26a6-45a0-94cc-7f02083b01fc', 'volume_name': 'volume-d47147a2-26a6-45a0-94cc-7f02083b01fc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c507e5-80f5-4315-8e91-321086c35fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c507e5-80f5-4315-8e91-321086c35fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fedef9f-bcb5-458b-a101-29d925deae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:39 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Volume d47147a2-26a6-45a0-94cc-7f02083b01fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47147a2-26a6-45a0-94cc-7f02083b01fc', 'volume_size': 1} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41c52283-1075-473e-bc46-da91b5491538,created_at=2026-07-11T16:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2121071954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41c52283-1075-473e-bc46-da91b5491538,host='devstack@QuobyteHD#QuobyteHD',id=d47147a2-26a6-45a0-94cc-7f02083b01fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd8ac3b4c84f9685b101ed2284960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:40Z,use_quota=True,user_id='0770a3a31f6b46f0a7370e3e4d5f4b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7938409c-e69a-4313-b8db-f5dd2c9bf578),volume_type_id=7938409c-e69a-4313-b8db-f5dd2c9bf578)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Creating volume d47147a2-26a6-45a0-94cc-7f02083b01fc {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:39 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:42:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:39 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc 1073741824 Jul 11 18:42:39 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:40 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc 1073741824" returned: 0 in 1.084s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:40 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc Jul 11 18:42:40 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:41 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc" returned: 0 in 0.786s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fedef9f-bcb5-458b-a101-29d925deae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47147a2-26a6-45a0-94cc-7f02083b01fc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f15a12-4519-4a0d-a4f9-db1010399544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Volume volume-d47147a2-26a6-45a0-94cc-7f02083b01fc (d47147a2-26a6-45a0-94cc-7f02083b01fc): created successfully Jul 11 18:42:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f15a12-4519-4a0d-a4f9-db1010399544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Flow 'volume_create_manager' (dde4e702-a9ae-4db5-8821-671a28a7b941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7fc8623c-fd1c-4ed5-bbf0-138fbd05f3ae tempest-GroupSnapshotsTest-797082451 None] Created volume successfully. Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Flow 'volume_create_manager' (b1d9c0a5-88c0-4261-9504-943f6b9aabc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74c58e5-330c-4716-8695-bee27b15c99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74c58e5-330c-4716-8695-bee27b15c99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1521284243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41c52283-1075-473e-bc46-da91b5491538,host='devstack@QuobyteHD#QuobyteHD',id=251f1794-769f-4757-9b85-5457aa2faeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd8ac3b4c84f9685b101ed2284960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:43Z,use_quota=True,user_id='0770a3a31f6b46f0a7370e3e4d5f4b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7938409c-e69a-4313-b8db-f5dd2c9bf578),volume_type_id=7938409c-e69a-4313-b8db-f5dd2c9bf578)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b4ffb4-e79d-4924-9c74-b50257bbe7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b4ffb4-e79d-4924-9c74-b50257bbe7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939c7f7e-ffc6-4fd4-945a-c187565d67e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939c7f7e-ffc6-4fd4-945a-c187565d67e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251f1794-769f-4757-9b85-5457aa2faeea', 'volume_name': 'volume-251f1794-769f-4757-9b85-5457aa2faeea', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d372f360-74b7-48a8-b9f2-513393b310c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d372f360-74b7-48a8-b9f2-513393b310c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aca1ef-c867-4dcd-89d9-535a4d229e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:42 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Volume 251f1794-769f-4757-9b85-5457aa2faeea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251f1794-769f-4757-9b85-5457aa2faeea', 'volume_size': 1} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41c52283-1075-473e-bc46-da91b5491538,created_at=2026-07-11T16:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1521284243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41c52283-1075-473e-bc46-da91b5491538,host='devstack@QuobyteHD#QuobyteHD',id=251f1794-769f-4757-9b85-5457aa2faeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd8ac3b4c84f9685b101ed2284960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:43Z,use_quota=True,user_id='0770a3a31f6b46f0a7370e3e4d5f4b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7938409c-e69a-4313-b8db-f5dd2c9bf578),volume_type_id=7938409c-e69a-4313-b8db-f5dd2c9bf578)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Creating volume 251f1794-769f-4757-9b85-5457aa2faeea {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:42:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:43 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea 1073741824 Jul 11 18:42:43 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:44 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea 1073741824" returned: 0 in 1.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:44 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea Jul 11 18:42:44 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:44 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea" returned: 0 in 0.757s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aca1ef-c867-4dcd-89d9-535a4d229e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251f1794-769f-4757-9b85-5457aa2faeea', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025712f4-bfaa-4017-b4db-319358ce2562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:44 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Volume volume-251f1794-769f-4757-9b85-5457aa2faeea (251f1794-769f-4757-9b85-5457aa2faeea): created successfully Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025712f4-bfaa-4017-b4db-319358ce2562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Flow 'volume_create_manager' (b1d9c0a5-88c0-4261-9504-943f6b9aabc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-56ce4638-a237-4a87-a2d3-e0e5b42d4834 tempest-GroupSnapshotsTest-797082451 None] Created volume successfully. Jul 11 18:42:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3903e68c-b061-41db-9896-d4891ffc7876 tempest-GroupSnapshotsTest-797082451 None] Update group completed successfully. Jul 11 18:42:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c7cd648e-a2a2-47d6-9f56-f6caf8ad801f tempest-GroupSnapshotsTest-797082451 None] Update group completed successfully. Jul 11 18:42:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9c5a901c-3fb8-4cfb-a808-3647b0b09bd1 tempest-GroupSnapshotsTest-797082451 None] Update group completed successfully. Jul 11 18:42:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-551a20e7-9582-413b-a553-c53803ce0725 tempest-GroupSnapshotsTest-797082451 None] Update group completed successfully. Jul 11 18:42:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] GroupSnapshot b3e465fd-ac8a-47e7-8a9f-c3b3962e80bf: creating. Jul 11 18:42:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Group snapshot b3e465fd-ac8a-47e7-8a9f-c3b3962e80bf: creating. {{(pid=87167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:42:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Creating offline snapshot c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 of volume d47147a2-26a6-45a0-94cc-7f02083b01fc {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:42:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29aa24c-da75-4eab-b844-a0f434113a6c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:51 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc Jul 11 18:42:51 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e3228133-abd6-466a-9802-208ab9005733 tempest-GroupSnapshotsV319Test-289918570 None] Group tempest-GroupSnapshotsV319Test-Group-1990537147: creating Jul 11 18:42:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e3228133-abd6-466a-9802-208ab9005733 tempest-GroupSnapshotsV319Test-289918570 None] Group tempest-GroupSnapshotsV319Test-Group-1990537147: created successfully Jul 11 18:42:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e3228133-abd6-466a-9802-208ab9005733 tempest-GroupSnapshotsV319Test-289918570 None] Create group completed successfully. Jul 11 18:42:51 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc" returned: 0 in 0.894s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:51 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 1G Jul 11 18:42:51 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:52 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 1G" returned: 0 in 0.877s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47147a2-26a6-45a0-94cc-7f02083b01fc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:52 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47147a2-26a6-45a0-94cc-7f02083b01fc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 Jul 11 18:42:52 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Flow 'volume_create_manager' (25881fdc-2b5c-4bec-9bf8-cdf58807e200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44891a40-7a57-4a9c-9dc4-d1321a63ed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44891a40-7a57-4a9c-9dc4-d1321a63ed37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2104260680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f189e0d-ab1f-444c-830b-5ad3a871155b,host='devstack@QuobyteHD#QuobyteHD',id=53b437b0-91cb-498b-9b18-b0d084873c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be07789d7157403cb3112ecc47783c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:53Z,use_quota=True,user_id='1257323817e541018b4e95d322dc33ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b76b2a73-9a60-48db-86ef-007c11b0c891),volume_type_id=b76b2a73-9a60-48db-86ef-007c11b0c891)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375dc34c-31c2-49b9-accc-be3afac332ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375dc34c-31c2-49b9-accc-be3afac332ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a26564b-e231-43a5-97bd-70f99e5fdae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a26564b-e231-43a5-97bd-70f99e5fdae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b437b0-91cb-498b-9b18-b0d084873c65', 'volume_name': 'volume-53b437b0-91cb-498b-9b18-b0d084873c65', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b918ebe-11e6-4a48-b9ec-d88d92c2b5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b918ebe-11e6-4a48-b9ec-d88d92c2b5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c566170-8e7d-4b38-b7ea-b1bd6fc23802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:53 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Volume 53b437b0-91cb-498b-9b18-b0d084873c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b437b0-91cb-498b-9b18-b0d084873c65', 'volume_size': 1} Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:53 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47147a2-26a6-45a0-94cc-7f02083b01fc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460" returned: 0 in 0.841s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:53 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:53 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 Jul 11 18:42:53 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:54 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460" returned: 0 in 0.677s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:54 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.info Jul 11 18:42:54 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:55 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.info" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:55 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:55 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.info Jul 11 18:42:55 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:55 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.info" returned: 0 in 0.687s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.757s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Creating offline snapshot cb5b8955-cdae-4b2a-b375-9c7be43a277b of volume 251f1794-769f-4757-9b85-5457aa2faeea {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[281a94b9-fca4-471a-95b9-90318bc5b0f8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:55 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea Jul 11 18:42:55 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:56 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea" returned: 0 in 0.898s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:56 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b 1G Jul 11 18:42:56 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:57 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b 1G" returned: 0 in 1.036s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251f1794-769f-4757-9b85-5457aa2faeea -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:57 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251f1794-769f-4757-9b85-5457aa2faeea -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b Jul 11 18:42:57 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:58 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251f1794-769f-4757-9b85-5457aa2faeea -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b" returned: 0 in 0.929s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:58 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:58 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b Jul 11 18:42:58 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:59 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b" returned: 0 in 0.737s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:59 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.info Jul 11 18:42:59 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:00 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.info" returned: 0 in 0.814s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:00 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.info Jul 11 18:43:00 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:00 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.info" returned: 0 in 0.696s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.231s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.669s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f189e0d-ab1f-444c-830b-5ad3a871155b,created_at=2026-07-11T16:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2104260680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f189e0d-ab1f-444c-830b-5ad3a871155b,host='devstack@QuobyteHD#QuobyteHD',id=53b437b0-91cb-498b-9b18-b0d084873c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be07789d7157403cb3112ecc47783c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:53Z,use_quota=True,user_id='1257323817e541018b4e95d322dc33ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b76b2a73-9a60-48db-86ef-007c11b0c891),volume_type_id=b76b2a73-9a60-48db-86ef-007c11b0c891)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Creating volume 53b437b0-91cb-498b-9b18-b0d084873c65 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:00 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:43:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:01 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 1073741824 Jul 11 18:43:01 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ce8778a5-3bc5-499f-b049-ab4094757569 tempest-GroupSnapshotsTest-797082451 None] group_snapshot b3e465fd-ac8a-47e7-8a9f-c3b3962e80bf: created successfully Jul 11 18:43:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] group_snapshot b3e465fd-ac8a-47e7-8a9f-c3b3962e80bf: deleting Jul 11 18:43:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] group_snapshot b3e465fd-ac8a-47e7-8a9f-c3b3962e80bf: deleting {{(pid=87167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:43:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-d47147a2-26a6-45a0-94cc-7f02083b01fc" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-d47147a2-26a6-45a0-94cc-7f02083b01fc" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-c97d35ff-7ebf-4cca-9f57-ceea6d3d3460" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-c97d35ff-7ebf-4cca-9f57-ceea6d3d3460" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Deleting offline snapshot c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 of volume d47147a2-26a6-45a0-94cc-7f02083b01fc {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:43:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] snapshot_file for this snap is: volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:43:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2858e6-b305-4ccb-8497-3ca3ffb6c736]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:02 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 Jul 11 18:43:02 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:02 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 1073741824" returned: 0 in 1.483s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:02 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 Jul 11 18:43:02 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:03 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460" returned: 0 in 1.023s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d47147a2-26a6-45a0-94cc-7f02083b01fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9142b51-19d8-4f18-a104-edcee5381b50]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:03 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc Jul 11 18:43:03 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:03 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65" returned: 0 in 0.843s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c566170-8e7d-4b38-b7ea-b1bd6fc23802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b437b0-91cb-498b-9b18-b0d084873c65', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f163a8-0ef8-4e70-9f92-61d50aefc181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Volume volume-53b437b0-91cb-498b-9b18-b0d084873c65 (53b437b0-91cb-498b-9b18-b0d084873c65): created successfully Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f163a8-0ef8-4e70-9f92-61d50aefc181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Flow 'volume_create_manager' (25881fdc-2b5c-4bec-9bf8-cdf58807e200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1cf9f1fe-9314-4f0b-ab87-24ea8a5fb42c tempest-GroupSnapshotsV319Test-289918570 None] Created volume successfully. Jul 11 18:43:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] GroupSnapshot 8384a2ed-55ea-4e31-89f2-fa655f50c72c: creating. Jul 11 18:43:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Group snapshot 8384a2ed-55ea-4e31-89f2-fa655f50c72c: creating. {{(pid=87167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:43:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Creating offline snapshot 78ed9a28-99bc-4a8e-a9dd-d39536f27af5 of volume 53b437b0-91cb-498b-9b18-b0d084873c65 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:43:04 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c74e8a-04a8-475b-9f99-85b199cf42b0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:04 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 Jul 11 18:43:04 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:04 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc" returned: 0 in 1.548s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:04 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 Jul 11 18:43:04 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:05 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65" returned: 0 in 1.158s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:05 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 1G Jul 11 18:43:05 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:05 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460" returned: 0 in 1.085s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:05 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460 Jul 11 18:43:05 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:07 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc.c97d35ff-7ebf-4cca-9f57-ceea6d3d3460" returned: 0 in 1.345s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-c97d35ff-7ebf-4cca-9f57-ceea6d3d3460" released by "_delete_snapshot" :: held 5.205s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-d47147a2-26a6-45a0-94cc-7f02083b01fc" released by "delete_snapshot" :: held 5.271s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-251f1794-769f-4757-9b85-5457aa2faeea" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-251f1794-769f-4757-9b85-5457aa2faeea" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-cb5b8955-cdae-4b2a-b375-9c7be43a277b" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:07 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-cb5b8955-cdae-4b2a-b375-9c7be43a277b" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Deleting offline snapshot cb5b8955-cdae-4b2a-b375-9c7be43a277b of volume 251f1794-769f-4757-9b85-5457aa2faeea {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] snapshot_file for this snap is: volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 1G" returned: 0 in 1.732s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b437b0-91cb-498b-9b18-b0d084873c65 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:07 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b437b0-91cb-498b-9b18-b0d084873c65 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 Jul 11 18:43:07 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f380e2d3-8562-46ac-95f4-3c9f57959ee0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Flow 'volume_create_manager' (3e043fcb-2615-47ad-89d6-0fec7f2d2403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff71f26e-56ab-45c0-af98-08b1969d09d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff71f26e-56ab-45c0-af98-08b1969d09d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51008148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb69074-b2eb-4db7-8690-93f846ad26a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b8c87ff91742409f0c3843848c6744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:07Z,use_quota=True,user_id='c76bab8dbe72466388431c3d363b53e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab15069-9241-42f1-ad1e-6b06e219eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab15069-9241-42f1-ad1e-6b06e219eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0d7c17-f490-4ec3-bbaf-6674e03c4604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0d7c17-f490-4ec3-bbaf-6674e03c4604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cb69074-b2eb-4db7-8690-93f846ad26a2', 'volume_name': 'volume-5cb69074-b2eb-4db7-8690-93f846ad26a2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:07 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b Jul 11 18:43:07 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f6360d-4f65-4b5c-b00f-72e484554e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f6360d-4f65-4b5c-b00f-72e484554e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f4ba2d-cfbe-4ddf-89c9-4624e7ce99da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Volume 5cb69074-b2eb-4db7-8690-93f846ad26a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cb69074-b2eb-4db7-8690-93f846ad26a2', 'volume_size': 1} Jul 11 18:43:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:08 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b437b0-91cb-498b-9b18-b0d084873c65 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5" returned: 0 in 1.008s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:08 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:08 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 Jul 11 18:43:08 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:08 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b" returned: 0 in 1.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-251f1794-769f-4757-9b85-5457aa2faeea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:43:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[615f09cd-8962-4304-a20e-589a1405a0bb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:09 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea Jul 11 18:43:09 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:09 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5" returned: 0 in 0.927s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:09 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.info Jul 11 18:43:09 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:10 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea" returned: 0 in 1.421s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:10 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b Jul 11 18:43:10 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:10 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.info" returned: 0 in 1.276s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:10 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:10 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.info Jul 11 18:43:10 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:11 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b" returned: 0 in 1.218s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:11 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b Jul 11 18:43:11 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:11 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.info" returned: 0 in 1.045s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.271s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.896s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51008148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb69074-b2eb-4db7-8690-93f846ad26a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b8c87ff91742409f0c3843848c6744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:07Z,use_quota=True,user_id='c76bab8dbe72466388431c3d363b53e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Creating volume 5cb69074-b2eb-4db7-8690-93f846ad26a2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:11 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:43:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:11 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 1073741824 Jul 11 18:43:11 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b0d24507-a174-4881-a153-8b939a5eaf62 tempest-GroupSnapshotsV319Test-289918570 None] group_snapshot 8384a2ed-55ea-4e31-89f2-fa655f50c72c: created successfully Jul 11 18:43:12 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea.cb5b8955-cdae-4b2a-b375-9c7be43a277b" returned: 0 in 1.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-cb5b8955-cdae-4b2a-b375-9c7be43a277b" released by "_delete_snapshot" :: held 5.262s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-251f1794-769f-4757-9b85-5457aa2faeea" released by "delete_snapshot" :: held 5.347s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:12 devstack cinder-volume[87167]: WARNING cinder.quota [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-532272711 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-532272711, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:12 devstack cinder-volume[87167]: WARNING cinder.quota [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-532272711 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-532272711, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Created reservations ['580f6c13-01a3-4ed2-b9ce-6e31b434cd73', 'dd345cfe-9da4-4ac0-be4b-0b157d748bf1', '951ebabc-3137-4c41-95c5-feee9514455d', '440081b8-8e46-4558-84e7-d27cc9ef1324'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] group_snapshot 8384a2ed-55ea-4e31-89f2-fa655f50c72c: deleting Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] Created reservations ['99f94fbc-15dc-484a-ac64-4bd68c1c2a08', 'a3c25ce4-9d12-4800-9b40-a8f063f01331', '6547dc17-a810-4f18-8e9a-50b32842b9e9', 'e97e9ce1-d349-494a-886a-947274fafe83'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] group_snapshot 8384a2ed-55ea-4e31-89f2-fa655f50c72c: deleting {{(pid=87167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Acquiring lock "cinder-quobyte-53b437b0-91cb-498b-9b18-b0d084873c65" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Lock "cinder-quobyte-53b437b0-91cb-498b-9b18-b0d084873c65" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Acquiring lock "cinder-quobyte-78ed9a28-99bc-4a8e-a9dd-d39536f27af5" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Lock "cinder-quobyte-78ed9a28-99bc-4a8e-a9dd-d39536f27af5" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Deleting offline snapshot 78ed9a28-99bc-4a8e-a9dd-d39536f27af5 of volume 53b437b0-91cb-498b-9b18-b0d084873c65 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] snapshot_file for this snap is: volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd299e9e-40ab-4a14-aa35-21bad19dcdc8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e9d69fc6-d289-4973-b8cd-61b786deceef tempest-GroupSnapshotsTest-797082451 None] group_snapshot b3e465fd-ac8a-47e7-8a9f-c3b3962e80bf: deleted successfully Jul 11 18:43:13 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 Jul 11 18:43:13 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:13 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 1073741824" returned: 0 in 1.868s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:13 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 Jul 11 18:43:13 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:14 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2" returned: 0 in 0.769s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] <== create_volume: return (2700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.707s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f4ba2d-cfbe-4ddf-89c9-4624e7ce99da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cb69074-b2eb-4db7-8690-93f846ad26a2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd0c29c-7e10-431c-8e70-194eeec4020e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Volume volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 (5cb69074-b2eb-4db7-8690-93f846ad26a2): created successfully Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd0c29c-7e10-431c-8e70-194eeec4020e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Flow 'volume_create_manager' (3e043fcb-2615-47ad-89d6-0fec7f2d2403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9497ac2b-e5a5-4878-8b04-ea6e5a8ec940 tempest-DeleteServersTestJSON-1062211587 None] Created volume successfully. Jul 11 18:43:14 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5" returned: 0 in 1.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53b437b0-91cb-498b-9b18-b0d084873c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e82a1a-a5d2-46a3-90c9-0918bff363da]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:14 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 Jul 11 18:43:14 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-251f1794-769f-4757-9b85-5457aa2faeea" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-251f1794-769f-4757-9b85-5457aa2faeea" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:43:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:43:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:43:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfae030-ee18-45a1-9fb6-02325775a704]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:15 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea Jul 11 18:43:15 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:15 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65" returned: 0 in 1.222s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:15 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 Jul 11 18:43:15 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:16 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea" returned: 0 in 1.555s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:16 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea Jul 11 18:43:16 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:16 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5" returned: 0 in 1.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:16 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5 Jul 11 18:43:16 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:17 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-251f1794-769f-4757-9b85-5457aa2faeea" returned: 0 in 0.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-251f1794-769f-4757-9b85-5457aa2faeea" released by "delete_volume" :: held 2.349s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-d47147a2-26a6-45a0-94cc-7f02083b01fc" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-d47147a2-26a6-45a0-94cc-7f02083b01fc" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7bf2e1-7524-439b-9a5c-976a17cc02a7]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:17 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc Jul 11 18:43:17 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:17 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65.78ed9a28-99bc-4a8e-a9dd-d39536f27af5" returned: 0 in 0.880s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Lock "cinder-quobyte-78ed9a28-99bc-4a8e-a9dd-d39536f27af5" released by "_delete_snapshot" :: held 4.634s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Lock "cinder-quobyte-53b437b0-91cb-498b-9b18-b0d084873c65" released by "delete_snapshot" :: held 4.734s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:18 devstack cinder-volume[87167]: WARNING cinder.quota [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1557624220 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1557624220, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:18 devstack cinder-volume[87167]: WARNING cinder.quota [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1557624220 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1557624220, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] Created reservations ['4a3fbacb-4c89-4f9e-8ccb-1ad93373082d', '88c0db65-1b0a-4ebd-b1f3-b956629779a9', '6f872193-4bfb-4337-8f58-9b40aeea7b12', '04924f65-0bbb-409d-8c08-0e7630e554df'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a85a8cb6-42fe-4d52-9435-1ee4b6f6b3eb tempest-GroupSnapshotsV319Test-289918570 None] group_snapshot 8384a2ed-55ea-4e31-89f2-fa655f50c72c: deleted successfully Jul 11 18:43:18 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc" returned: 0 in 1.315s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:18 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc Jul 11 18:43:18 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-6bc3bdb3-5dd6-4376-9b38-b12346ddf7b2 req-0046e127-165b-4d16-abbb-b246193a8d5b tempest-DeleteServersTestJSON-1062211587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-6bc3bdb3-5dd6-4376-9b38-b12346ddf7b2 req-0046e127-165b-4d16-abbb-b246193a8d5b tempest-DeleteServersTestJSON-1062211587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c7c34d-7d20-488b-90ef-84631b9c2265]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-6bc3bdb3-5dd6-4376-9b38-b12346ddf7b2 req-0046e127-165b-4d16-abbb-b246193a8d5b tempest-DeleteServersTestJSON-1062211587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:19 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 Jul 11 18:43:19 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Acquiring lock "cinder-quobyte-53b437b0-91cb-498b-9b18-b0d084873c65" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Lock "cinder-quobyte-53b437b0-91cb-498b-9b18-b0d084873c65" acquired by "delete_volume" :: waited 0.049s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[718626a8-cf84-481b-8779-b3fbce7705b8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:19 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d47147a2-26a6-45a0-94cc-7f02083b01fc" returned: 0 in 0.955s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-d47147a2-26a6-45a0-94cc-7f02083b01fc" released by "delete_volume" :: held 2.392s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:19 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 Jul 11 18:43:19 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Created reservations ['64c5e3a8-abca-441c-bd66-5b2f77033487'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:19 devstack cinder-volume[87167]: WARNING cinder.quota [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-532272711 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-532272711, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Created reservations ['7446cea8-a6a5-4fde-9d64-194e749e7530', '319110a0-0993-4c0a-bc06-d7ac70de59e2', 'de3f3707-971c-44e4-a443-67dc65660950', 'dcfb69cb-4d46-456d-9aef-d366202b5a80'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:20 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-6bc3bdb3-5dd6-4376-9b38-b12346ddf7b2 req-0046e127-165b-4d16-abbb-b246193a8d5b tempest-DeleteServersTestJSON-1062211587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2" returned: 0 in 1.079s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-6bc3bdb3-5dd6-4376-9b38-b12346ddf7b2 req-0046e127-165b-4d16-abbb-b246193a8d5b tempest-DeleteServersTestJSON-1062211587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.105s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-6bc3bdb3-5dd6-4376-9b38-b12346ddf7b2 req-0046e127-165b-4d16-abbb-b246193a8d5b tempest-DeleteServersTestJSON-1062211587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-5cb69074-b2eb-4db7-8690-93f846ad26a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '297c2386-64f7-40d2-ab4a-f0d975f7139d', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Created reservations ['0dc7c92b-47f9-41c3-8dbd-4cdbfdc067f8', '9ffff68b-7b16-4ac4-b9e0-eba6d70c97a1', 'e26d2c65-b5c8-4f9e-b9a9-448d4b90c43a', '65767fe6-21ef-4ea8-bbff-adbd9fbede49'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-6bc3bdb3-5dd6-4376-9b38-b12346ddf7b2 req-0046e127-165b-4d16-abbb-b246193a8d5b tempest-DeleteServersTestJSON-1062211587 None] attachment_update completed successfully. Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:20 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:43:20 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:20 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65" returned: 0 in 1.244s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:20 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65 Jul 11 18:43:20 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8cfb486d-b764-4d58-a53a-9f6faf013e59 tempest-GroupSnapshotsTest-797082451 None] Group tempest-GroupSnapshotsTest-Group-1404626267: creating Jul 11 18:43:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8cfb486d-b764-4d58-a53a-9f6faf013e59 tempest-GroupSnapshotsTest-797082451 None] Group tempest-GroupSnapshotsTest-Group-1404626267: created successfully Jul 11 18:43:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8cfb486d-b764-4d58-a53a-9f6faf013e59 tempest-GroupSnapshotsTest-797082451 None] Create group completed successfully. Jul 11 18:43:21 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.895s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-568eeb84-2ef0-4466-8ce5-39985374b6cf tempest-GroupSnapshotsTest-797082451 None] Delete group completed successfully. Jul 11 18:43:21 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-53b437b0-91cb-498b-9b18-b0d084873c65" returned: 0 in 0.725s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Lock "cinder-quobyte-53b437b0-91cb-498b-9b18-b0d084873c65" released by "delete_volume" :: held 2.061s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Created reservations ['f664cbe5-1a08-4f32-aef7-ff909100dda4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:21 devstack cinder-volume[87167]: WARNING cinder.quota [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1557624220 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1557624220, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Created reservations ['ac6d235f-0c3a-46f2-ae41-39f11f382e6e', 'b309f7dd-8338-4ecb-879c-ccfffa657dd8', '93d8c246-5e0e-4c80-8d44-dc4c4fafbc61', '99cbc219-7122-4ce1-8064-225b75619479'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:21 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:43:21 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:22 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.661s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7a481e56-1969-4726-802b-da754f52276f tempest-GroupSnapshotsV319Test-289918570 None] Delete group completed successfully. Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Flow 'volume_create_manager' (48ab0af3-8a92-4832-922e-92c826821c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3615dc-4af1-4cb2-9735-1e93b8e67f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3615dc-4af1-4cb2-9735-1e93b8e67f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1323185693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0180c8af-5611-4484-acf8-e17c015e5dc2,host='devstack@QuobyteHD#QuobyteHD',id=d34fc639-d622-4120-9906-b4ec30284847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd8ac3b4c84f9685b101ed2284960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:23Z,use_quota=True,user_id='0770a3a31f6b46f0a7370e3e4d5f4b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddd77a70-d54e-4330-ab20-f23db553a2fe),volume_type_id=ddd77a70-d54e-4330-ab20-f23db553a2fe)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30626a51-684e-4dc9-824b-f64fb797705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30626a51-684e-4dc9-824b-f64fb797705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694ae6af-4cc3-4690-832d-b0fe4f125261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694ae6af-4cc3-4690-832d-b0fe4f125261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34fc639-d622-4120-9906-b4ec30284847', 'volume_name': 'volume-d34fc639-d622-4120-9906-b4ec30284847', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bb63aa-2585-46e8-b982-ec95dc2a4d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bb63aa-2585-46e8-b982-ec95dc2a4d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4ff54-f386-4937-aadd-ce2f210aa071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:22 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Volume d34fc639-d622-4120-9906-b4ec30284847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34fc639-d622-4120-9906-b4ec30284847', 'volume_size': 1} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0180c8af-5611-4484-acf8-e17c015e5dc2,created_at=2026-07-11T16:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1323185693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0180c8af-5611-4484-acf8-e17c015e5dc2,host='devstack@QuobyteHD#QuobyteHD',id=d34fc639-d622-4120-9906-b4ec30284847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd8ac3b4c84f9685b101ed2284960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:23Z,use_quota=True,user_id='0770a3a31f6b46f0a7370e3e4d5f4b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddd77a70-d54e-4330-ab20-f23db553a2fe),volume_type_id=ddd77a70-d54e-4330-ab20-f23db553a2fe)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Creating volume d34fc639-d622-4120-9906-b4ec30284847 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:22 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:43:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:22 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 1073741824 Jul 11 18:43:22 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:23 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 1073741824" returned: 0 in 0.861s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:23 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 Jul 11 18:43:23 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:24 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4ff54-f386-4937-aadd-ce2f210aa071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34fc639-d622-4120-9906-b4ec30284847', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc4d5d2-99bc-4a67-9583-ac43c6d4d14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Volume volume-d34fc639-d622-4120-9906-b4ec30284847 (d34fc639-d622-4120-9906-b4ec30284847): created successfully Jul 11 18:43:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc4d5d2-99bc-4a67-9583-ac43c6d4d14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Flow 'volume_create_manager' (48ab0af3-8a92-4832-922e-92c826821c8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-14bf2622-2b73-428f-9da1-af825dc54bcd tempest-GroupSnapshotsTest-797082451 None] Created volume successfully. Jul 11 18:43:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] GroupSnapshot 98fc6346-59dd-4232-8489-59445563bae3: creating. Jul 11 18:43:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Group snapshot 98fc6346-59dd-4232-8489-59445563bae3: creating. {{(pid=87167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:43:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Creating offline snapshot ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 of volume d34fc639-d622-4120-9906-b4ec30284847 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:43:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab75452-d733-49cb-9b6c-71963bde0621]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:25 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 Jul 11 18:43:25 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:26 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847" returned: 0 in 0.820s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:26 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 1G Jul 11 18:43:26 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:27 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 1G" returned: 0 in 1.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34fc639-d622-4120-9906-b4ec30284847 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:27 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34fc639-d622-4120-9906-b4ec30284847 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 Jul 11 18:43:27 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:27 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=109,cinder:SELECT=117,cinder:DELETE=6,cinder:INSERT=23 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:43:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-70271feb-2dd1-45dd-8c89-089f9134b907 tempest-GroupsTest-874972503 None] Group tempest-Group1-955785906: creating Jul 11 18:43:27 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=108,cinder:INSERT=29,cinder:UPDATE=114 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:43:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-70271feb-2dd1-45dd-8c89-089f9134b907 tempest-GroupsTest-874972503 None] Group tempest-Group1-955785906: created successfully Jul 11 18:43:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-70271feb-2dd1-45dd-8c89-089f9134b907 tempest-GroupsTest-874972503 None] Create group completed successfully. Jul 11 18:43:28 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34fc639-d622-4120-9906-b4ec30284847 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6" returned: 0 in 1.048s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:28 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:28 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 Jul 11 18:43:28 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-258205bf-08a6-4761-ab30-3b44d6176a63 tempest-GroupsTest-874972503 None] Group tempest-Group2-87257412: creating Jul 11 18:43:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-258205bf-08a6-4761-ab30-3b44d6176a63 tempest-GroupsTest-874972503 None] Group tempest-Group2-87257412: created successfully Jul 11 18:43:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-258205bf-08a6-4761-ab30-3b44d6176a63 tempest-GroupsTest-874972503 None] Create group completed successfully. Jul 11 18:43:29 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:29 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.info Jul 11 18:43:29 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-eec02e0f-facd-48e7-ae74-3cd8daff72c1 req-6cb149f4-a976-4e46-8225-dc2b2db447f1 tempest-DeleteServersTestJSON-1062211587 None] Terminate volume connection completed successfully. Jul 11 18:43:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-eec02e0f-facd-48e7-ae74-3cd8daff72c1 req-6cb149f4-a976-4e46-8225-dc2b2db447f1 tempest-DeleteServersTestJSON-1062211587 None] Deleting attachment 297c2386-64f7-40d2-ab4a-f0d975f7139d. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:43:29 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.info" returned: 0 in 0.661s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:29 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:29 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.info Jul 11 18:43:29 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Flow 'volume_create_manager' (af4cc243-afb3-4b4f-8abd-3a6a75de78c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f46f06-aa0c-4154-b8ad-777f1b844ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f46f06-aa0c-4154-b8ad-777f1b844ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-129546502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db46277b-15dc-4307-90d6-1ef31e7eef08,host='devstack@QuobyteHD#QuobyteHD',id=647ee43e-5afe-4aba-b018-664a5a6db1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dad6d8e9d149078e44baa4e5efb857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:31Z,use_quota=True,user_id='6e5a2d64ec0f4c6cacf6ab56b8f55579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f0c5446-df37-47c7-af86-5b212f4bac87),volume_type_id=4f0c5446-df37-47c7-af86-5b212f4bac87)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2b502d-e599-478f-a48e-445afed3b49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2b502d-e599-478f-a48e-445afed3b49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bb9c39-950e-4016-a679-0dc243a33e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bb9c39-950e-4016-a679-0dc243a33e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647ee43e-5afe-4aba-b018-664a5a6db1a2', 'volume_name': 'volume-647ee43e-5afe-4aba-b018-664a5a6db1a2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab20785-1920-4d4d-9e8b-bc2e33973706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab20785-1920-4d4d-9e8b-bc2e33973706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4adc6397-51be-48a1-9050-622b36ab60f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Volume 647ee43e-5afe-4aba-b018-664a5a6db1a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647ee43e-5afe-4aba-b018-664a5a6db1a2', 'volume_size': 1} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.info" returned: 0 in 0.773s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.162s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db46277b-15dc-4307-90d6-1ef31e7eef08,created_at=2026-07-11T16:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-129546502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db46277b-15dc-4307-90d6-1ef31e7eef08,host='devstack@QuobyteHD#QuobyteHD',id=647ee43e-5afe-4aba-b018-664a5a6db1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dad6d8e9d149078e44baa4e5efb857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:31Z,use_quota=True,user_id='6e5a2d64ec0f4c6cacf6ab56b8f55579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f0c5446-df37-47c7-af86-5b212f4bac87),volume_type_id=4f0c5446-df37-47c7-af86-5b212f4bac87)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Creating volume 647ee43e-5afe-4aba-b018-664a5a6db1a2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:30 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:43:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:30 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 1073741824 Jul 11 18:43:30 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bde4104a-fb0b-4822-b4bd-1360b0cd8d14 tempest-GroupSnapshotsTest-797082451 None] group_snapshot 98fc6346-59dd-4232-8489-59445563bae3: created successfully Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Flow 'volume_create_manager' (f929ca00-eb47-4c8c-94fb-e857a0868860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4324e413-b89d-4feb-8f03-83836d6f3d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4324e413-b89d-4feb-8f03-83836d6f3d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-677494310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ee7ef7-9e53-4a99-8501-cf5c8508384f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c55ccfddc34d9a866174f8a5884e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:31Z,use_quota=True,user_id='8604bfc1b06e434bad093f6c28e3b830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65aaf829-4c55-4806-93d7-79b9e079cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65aaf829-4c55-4806-93d7-79b9e079cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e01ebfe-26d0-4e42-955f-605544fc5246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e01ebfe-26d0-4e42-955f-605544fc5246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ee7ef7-9e53-4a99-8501-cf5c8508384f', 'volume_name': 'volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066b7a41-88da-4283-9244-9bc674632c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066b7a41-88da-4283-9244-9bc674632c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc61866-1ad2-4352-947e-dd9c44a4c2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Volume 64ee7ef7-9e53-4a99-8501-cf5c8508384f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f', 'volume_size': 1} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:31 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 1073741824" returned: 0 in 0.935s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:31 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 Jul 11 18:43:31 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] group_snapshot 98fc6346-59dd-4232-8489-59445563bae3: deleting Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] group_snapshot 98fc6346-59dd-4232-8489-59445563bae3: deleting {{(pid=87167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-d34fc639-d622-4120-9906-b4ec30284847" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-d34fc639-d622-4120-9906-b4ec30284847" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Deleting offline snapshot ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 of volume d34fc639-d622-4120-9906-b4ec30284847 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] snapshot_file for this snap is: volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1172b3c-8439-42ad-88b7-4c988fc37f2d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:32 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 Jul 11 18:43:32 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:32 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2" returned: 0 in 0.781s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-677494310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ee7ef7-9e53-4a99-8501-cf5c8508384f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c55ccfddc34d9a866174f8a5884e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:31Z,use_quota=True,user_id='8604bfc1b06e434bad093f6c28e3b830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Creating volume 64ee7ef7-9e53-4a99-8501-cf5c8508384f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:32 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:32 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f 1073741824 Jul 11 18:43:32 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4adc6397-51be-48a1-9050-622b36ab60f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647ee43e-5afe-4aba-b018-664a5a6db1a2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cab544-7187-4cfc-b524-fdb7064623fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Volume volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 (647ee43e-5afe-4aba-b018-664a5a6db1a2): created successfully Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cab544-7187-4cfc-b524-fdb7064623fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Flow 'volume_create_manager' (af4cc243-afb3-4b4f-8abd-3a6a75de78c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dafe397b-69a3-493d-a808-61ab3baa10a0 tempest-GroupsTest-874972503 None] Created volume successfully. Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Acquiring lock "cinder-5cb69074-b2eb-4db7-8690-93f846ad26a2-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Lock "cinder-5cb69074-b2eb-4db7-8690-93f846ad26a2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Acquiring lock "cinder-quobyte-5cb69074-b2eb-4db7-8690-93f846ad26a2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:33 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6" returned: 0 in 1.186s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34fc639-d622-4120-9906-b4ec30284847(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Lock "cinder-quobyte-5cb69074-b2eb-4db7-8690-93f846ad26a2" acquired by "delete_volume" :: waited 0.074s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e33bbca-b500-4a9a-b871-8be881284dee]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa362a-c7da-4503-af9b-afd45ea55dce]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:33 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 Jul 11 18:43:33 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:33 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 Jul 11 18:43:33 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:33 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f 1073741824" returned: 0 in 1.270s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:33 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f Jul 11 18:43:33 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Acquiring lock "cinder-quobyte-647ee43e-5afe-4aba-b018-664a5a6db1a2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Lock "cinder-quobyte-647ee43e-5afe-4aba-b018-664a5a6db1a2" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2520254-2daa-4ea2-8d8f-86cbb96494cb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:34 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 Jul 11 18:43:34 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:34 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847" returned: 0 in 1.138s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:34 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 Jul 11 18:43:34 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:34 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2" returned: 0 in 1.245s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:34 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2 Jul 11 18:43:34 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:34 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f" returned: 0 in 0.996s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.338s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc61866-1ad2-4352-947e-dd9c44a4c2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52115aa-714c-4057-9ea5-83d4f4940182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Volume volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f (64ee7ef7-9e53-4a99-8501-cf5c8508384f): created successfully Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52115aa-714c-4057-9ea5-83d4f4940182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Flow 'volume_create_manager' (f929ca00-eb47-4c8c-94fb-e857a0868860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-714d1d6f-3fec-4572-9ebe-852431b87615 tempest-ServerActionsTestOtherA-1779163556 None] Created volume successfully. Jul 11 18:43:35 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2" returned: 0 in 1.072s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:35 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2 Jul 11 18:43:35 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:35 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5cb69074-b2eb-4db7-8690-93f846ad26a2" returned: 0 in 0.815s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Lock "cinder-quobyte-5cb69074-b2eb-4db7-8690-93f846ad26a2" released by "delete_volume" :: held 2.135s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Created reservations ['415bc961-3478-4f22-9947-d7e22d00f5cc', '7c625635-e3a6-4a60-b609-97ff7d24107c', 'f2aca56b-f168-43cc-8e22-8346f7ace4e4', '52301bb8-1d1d-4037-a229-b8d1f8e061c0'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:35 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6" returned: 0 in 1.040s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:35 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6 Jul 11 18:43:35 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:35 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:43:35 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:35 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-647ee43e-5afe-4aba-b018-664a5a6db1a2" returned: 0 in 0.826s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Lock "cinder-quobyte-647ee43e-5afe-4aba-b018-664a5a6db1a2" released by "delete_volume" :: held 1.963s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Created reservations ['644bd78e-f2da-489a-812a-cc32259753dc'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:36 devstack cinder-volume[87167]: WARNING cinder.quota [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-323740026 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-323740026, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:36 devstack cinder-volume[87167]: WARNING cinder.quota [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-323740026 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-323740026, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Created reservations ['1279924b-8d74-4bef-aafc-aa816ef47511', '14b8698f-df87-4dcf-aa53-8c0c6c236a65', '173906d9-74e5-477f-8aff-58981071433c', 'b65f10ce-d840-4373-a18d-130c63432fa4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:36 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:43:36 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:36 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847.ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6" returned: 0 in 0.706s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-ea3db3cf-ffd0-48a4-8101-4b24c0d9d4a6" released by "_delete_snapshot" :: held 4.240s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-d34fc639-d622-4120-9906-b4ec30284847" released by "delete_snapshot" :: held 4.271s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:36 devstack cinder-volume[87167]: WARNING cinder.quota [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-150436093 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-150436093, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:36 devstack cinder-volume[87167]: WARNING cinder.quota [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-150436093 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-150436093, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] Created reservations ['61c08970-5fd4-4bc0-bf3b-26bca6071b4a', '58182b09-44ed-4bf4-9afa-939fba012e8f', '9d11af03-ee1b-42b6-9b63-5adef5f68c34', '29d891aa-b65a-45c2-99ec-3a07663eb5b4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:36 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.819s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Deleted volume successfully. Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2eeba228-ad25-4e7e-8164-7e24865d858a tempest-DeleteServersTestJSON-1062211587 None] Lock "cinder-5cb69074-b2eb-4db7-8690-93f846ad26a2-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-972930a3-44f8-4cd9-a2cf-ec529b0811a8 tempest-GroupSnapshotsTest-797082451 None] group_snapshot 98fc6346-59dd-4232-8489-59445563bae3: deleted successfully Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Created reservations ['9274c9fd-991e-4d0a-8e1d-4a3798fd653b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:36 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:43:36 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:36 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.764s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:36 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3561dce6-2dd3-4ded-b3ee-fb3b642ac3ca tempest-GroupsTest-874972503 None] Delete group completed successfully. Jul 11 18:43:37 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.696s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3f6de9e4-8e34-49c6-b407-4fffb071ca5c tempest-GroupsTest-874972503 None] Delete group completed successfully. Jul 11 18:43:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "cinder-quobyte-d34fc639-d622-4120-9906-b4ec30284847" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-d34fc639-d622-4120-9906-b4ec30284847" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d77bbe4-d6ad-4ca8-b604-0c2d3a38fe71]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:38 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 Jul 11 18:43:38 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fe945123-174a-42b9-be40-4af4092952a1 tempest-GroupsTest-874972503 None] Group tempest-GroupsTest-Group-848718401: creating Jul 11 18:43:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fe945123-174a-42b9-be40-4af4092952a1 tempest-GroupsTest-874972503 None] Group tempest-GroupsTest-Group-848718401: created successfully Jul 11 18:43:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fe945123-174a-42b9-be40-4af4092952a1 tempest-GroupsTest-874972503 None] Create group completed successfully. Jul 11 18:43:38 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847" returned: 0 in 0.870s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:38 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847 Jul 11 18:43:38 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:39 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d34fc639-d622-4120-9906-b4ec30284847" returned: 0 in 0.700s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Lock "cinder-quobyte-d34fc639-d622-4120-9906-b4ec30284847" released by "delete_volume" :: held 1.684s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Created reservations ['3272264e-ce31-4e01-87bc-5035c2ea25d4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:39 devstack cinder-volume[87167]: WARNING cinder.quota [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-150436093 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-150436093, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Created reservations ['af2261c8-6528-4591-bcec-8ce02be6078e', '3ce2bb89-b590-42fd-82c8-02bfe5cb6344', '9948ed66-beb6-4d34-8433-943465afd603', '2f0cbb7d-2298-43c5-a999-95e2fa599826'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:40 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:43:40 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Flow 'volume_create_manager' (b388217f-93e5-439b-b93a-2c7a43d64304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83bc3b8-71bb-4099-a183-becfad162efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83bc3b8-71bb-4099-a183-becfad162efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095033069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05744901-9170-4948-bc3b-b7dfe6968b8b,host='devstack@QuobyteHD#QuobyteHD',id=59c0a8ed-c64b-41de-81fc-5b0b6f6f195b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dad6d8e9d149078e44baa4e5efb857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:40Z,use_quota=True,user_id='6e5a2d64ec0f4c6cacf6ab56b8f55579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85aa3c1f-88f7-4dfd-bf13-8f5539dad169),volume_type_id=85aa3c1f-88f7-4dfd-bf13-8f5539dad169)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94502346-b224-4df6-afa2-4e68a9a7a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94502346-b224-4df6-afa2-4e68a9a7a99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c69f3a-f38d-40e4-b017-6a7c104ff522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c69f3a-f38d-40e4-b017-6a7c104ff522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59c0a8ed-c64b-41de-81fc-5b0b6f6f195b', 'volume_name': 'volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1691285-75b7-4373-ab0e-2d6797710abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1691285-75b7-4373-ab0e-2d6797710abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409648cc-2a51-4433-93d9-b65c5e6b9a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Volume 59c0a8ed-c64b-41de-81fc-5b0b6f6f195b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b', 'volume_size': 1} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05744901-9170-4948-bc3b-b7dfe6968b8b,created_at=2026-07-11T16:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095033069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05744901-9170-4948-bc3b-b7dfe6968b8b,host='devstack@QuobyteHD#QuobyteHD',id=59c0a8ed-c64b-41de-81fc-5b0b6f6f195b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dad6d8e9d149078e44baa4e5efb857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:40Z,use_quota=True,user_id='6e5a2d64ec0f4c6cacf6ab56b8f55579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85aa3c1f-88f7-4dfd-bf13-8f5539dad169),volume_type_id=85aa3c1f-88f7-4dfd-bf13-8f5539dad169)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Creating volume 59c0a8ed-c64b-41de-81fc-5b0b6f6f195b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:43:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:40 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b 1073741824 Jul 11 18:43:40 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:41 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-cb6047c8-c9e1-4191-af92-09ff51505d2f tempest-GroupSnapshotsTest-797082451 None] Delete group completed successfully. Jul 11 18:43:41 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b 1073741824" returned: 0 in 1.371s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:41 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b Jul 11 18:43:41 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:42 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b" returned: 0 in 0.801s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409648cc-2a51-4433-93d9-b65c5e6b9a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3570cb-60ee-432f-9001-f828b0370ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:42 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Volume volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b (59c0a8ed-c64b-41de-81fc-5b0b6f6f195b): created successfully Jul 11 18:43:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3570cb-60ee-432f-9001-f828b0370ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Flow 'volume_create_manager' (b388217f-93e5-439b-b93a-2c7a43d64304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-59b15254-8d3c-432e-b486-5fa800341bb1 tempest-GroupsTest-874972503 None] Created volume successfully. Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Flow 'volume_create_manager' (7f0561e4-98b8-40a0-9b47-3fe33e54d299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2f126c-72b4-4021-a522-6fc2e3a36f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2f126c-72b4-4021-a522-6fc2e3a36f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-692445009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05744901-9170-4948-bc3b-b7dfe6968b8b,host='devstack@QuobyteHD#QuobyteHD',id=8340f9c6-7599-4601-822a-80a576b70d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dad6d8e9d149078e44baa4e5efb857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:44Z,use_quota=True,user_id='6e5a2d64ec0f4c6cacf6ab56b8f55579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85aa3c1f-88f7-4dfd-bf13-8f5539dad169),volume_type_id=85aa3c1f-88f7-4dfd-bf13-8f5539dad169)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26240b16-ded7-487d-8986-33e47d52ceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26240b16-ded7-487d-8986-33e47d52ceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e01024f-f92d-45e3-a131-c67517712a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e01024f-f92d-45e3-a131-c67517712a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8340f9c6-7599-4601-822a-80a576b70d90', 'volume_name': 'volume-8340f9c6-7599-4601-822a-80a576b70d90', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ef4375-5405-4eb6-9f72-d5b7a72de2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ef4375-5405-4eb6-9f72-d5b7a72de2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a80fa76-52ea-481f-9f0b-0e7a648fa7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Volume 8340f9c6-7599-4601-822a-80a576b70d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8340f9c6-7599-4601-822a-80a576b70d90', 'volume_size': 1} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05744901-9170-4948-bc3b-b7dfe6968b8b,created_at=2026-07-11T16:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-692445009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05744901-9170-4948-bc3b-b7dfe6968b8b,host='devstack@QuobyteHD#QuobyteHD',id=8340f9c6-7599-4601-822a-80a576b70d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dad6d8e9d149078e44baa4e5efb857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:44Z,use_quota=True,user_id='6e5a2d64ec0f4c6cacf6ab56b8f55579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85aa3c1f-88f7-4dfd-bf13-8f5539dad169),volume_type_id=85aa3c1f-88f7-4dfd-bf13-8f5539dad169)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Creating volume 8340f9c6-7599-4601-822a-80a576b70d90 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:43:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:43 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 1073741824 Jul 11 18:43:43 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:44 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 1073741824" returned: 0 in 1.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:44 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 Jul 11 18:43:44 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:45 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90" returned: 0 in 0.765s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a80fa76-52ea-481f-9f0b-0e7a648fa7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8340f9c6-7599-4601-822a-80a576b70d90', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e10c00-682e-48d0-8b06-1100ae3bb3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Volume volume-8340f9c6-7599-4601-822a-80a576b70d90 (8340f9c6-7599-4601-822a-80a576b70d90): created successfully Jul 11 18:43:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e10c00-682e-48d0-8b06-1100ae3bb3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Flow 'volume_create_manager' (7f0561e4-98b8-40a0-9b47-3fe33e54d299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e3cab6f1-0a21-4c2c-b2f4-62a5ea4ad6c3 tempest-GroupsTest-874972503 None] Created volume successfully. Jul 11 18:43:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c334f990-af80-4130-87fa-bd1119bfaadd tempest-GroupsTest-874972503 None] Update group completed successfully. Jul 11 18:43:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f864ddb0-b3b6-416b-8413-b0bd41bd761f tempest-GroupsTest-874972503 None] Update group completed successfully. Jul 11 18:43:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a126bc19-4cde-4b91-955f-9779c88ab1ea tempest-GroupsV314Test-1014437361 None] Group tempest-GroupsV314Test-Group-727390259: creating Jul 11 18:43:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a126bc19-4cde-4b91-955f-9779c88ab1ea tempest-GroupsV314Test-1014437361 None] Group tempest-GroupsV314Test-Group-727390259: created successfully Jul 11 18:43:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a126bc19-4cde-4b91-955f-9779c88ab1ea tempest-GroupsV314Test-1014437361 None] Create group completed successfully. Jul 11 18:43:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Acquiring lock "cinder-quobyte-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Flow 'volume_create_manager' (1efe6bc2-da60-40bd-9055-dc7ff47da9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16a0f15-be9f-4821-99d6-5f5ba97d2ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Lock "cinder-quobyte-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b" acquired by "delete_volume" :: waited 0.234s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[89299696-8c09-424b-b6e4-85e555cfe5c4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16a0f15-be9f-4821-99d6-5f5ba97d2ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265310153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f22e3447-1b37-4ca7-8f19-e89cc2e01c71,host='devstack@QuobyteHD#QuobyteHD',id=c9c37cf3-f1b1-4f5b-94cd-061b677ebde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38bf6983e9264e3e8235a24f4fc42be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:50Z,use_quota=True,user_id='d03031721ede4fa0ab37d9a0833dfe78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d156057-8434-4a54-99f3-5614564a713c),volume_type_id=9d156057-8434-4a54-99f3-5614564a713c)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1633842a-f61a-44fc-bc40-7ae411053f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1633842a-f61a-44fc-bc40-7ae411053f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51a4a77-1c2d-4116-ba37-3256e82de6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51a4a77-1c2d-4116-ba37-3256e82de6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c37cf3-f1b1-4f5b-94cd-061b677ebde4', 'volume_name': 'volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4127fed4-24de-4794-9846-15bf83e6297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4127fed4-24de-4794-9846-15bf83e6297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5394afc8-b4ae-431b-ad13-b00c9b698e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Volume c9c37cf3-f1b1-4f5b-94cd-061b677ebde4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4', 'volume_size': 1} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f22e3447-1b37-4ca7-8f19-e89cc2e01c71,created_at=2026-07-11T16:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265310153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f22e3447-1b37-4ca7-8f19-e89cc2e01c71,host='devstack@QuobyteHD#QuobyteHD',id=c9c37cf3-f1b1-4f5b-94cd-061b677ebde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38bf6983e9264e3e8235a24f4fc42be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:50Z,use_quota=True,user_id='d03031721ede4fa0ab37d9a0833dfe78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d156057-8434-4a54-99f3-5614564a713c),volume_type_id=9d156057-8434-4a54-99f3-5614564a713c)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Creating volume c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:50 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:43:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:50 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 1073741824 Jul 11 18:43:50 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:50 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b Jul 11 18:43:50 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:51 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b" returned: 0 in 1.126s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:51 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b Jul 11 18:43:51 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:51 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 1073741824" returned: 0 in 1.164s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:51 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 Jul 11 18:43:51 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:52 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b" returned: 0 in 1.335s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Lock "cinder-quobyte-59c0a8ed-c64b-41de-81fc-5b0b6f6f195b" released by "delete_volume" :: held 2.590s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Acquiring lock "cinder-quobyte-8340f9c6-7599-4601-822a-80a576b70d90" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Lock "cinder-quobyte-8340f9c6-7599-4601-822a-80a576b70d90" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[88040569-27ac-4480-9bd6-5e091e333d62]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:52 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" returned: 0 in 1.293s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] <== create_volume: return (2549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.554s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5394afc8-b4ae-431b-ad13-b00c9b698e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cba2ac5-b1a4-46d4-8dac-fbad9cd436d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:52 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Volume volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 (c9c37cf3-f1b1-4f5b-94cd-061b677ebde4): created successfully Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cba2ac5-b1a4-46d4-8dac-fbad9cd436d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Flow 'volume_create_manager' (1efe6bc2-da60-40bd-9055-dc7ff47da9bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-82e4f0ec-0e2f-4f5d-901a-db0c4f8a0d0e tempest-GroupsV314Test-1014437361 None] Created volume successfully. Jul 11 18:43:52 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 Jul 11 18:43:52 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:53 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90" returned: 0 in 1.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:53 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90 Jul 11 18:43:53 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:54 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8340f9c6-7599-4601-822a-80a576b70d90" returned: 0 in 1.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Lock "cinder-quobyte-8340f9c6-7599-4601-822a-80a576b70d90" released by "delete_volume" :: held 2.189s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:54 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Created reservations ['69ab1dfb-403e-4dc0-90a6-b945d64f59f4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:54 devstack cinder-volume[87167]: WARNING cinder.quota [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1357450256 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1357450256, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:54 devstack cinder-volume[87167]: WARNING cinder.quota [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1357450256 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1357450256, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:54 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Created reservations ['bd5c78d6-4d72-454a-9bb0-866d84bef9eb', 'fd7b05b9-d848-490b-9f87-193170907f9b', 'f298642d-7257-456c-b579-e168accfd406', '19aee98b-69eb-4094-9dc5-d73674fc0224'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Created reservations ['4c43b08c-797b-449e-a534-1d07c0c417fa', '36da4aa8-deed-4f62-9e73-8c7292e72f2f', '97975869-a51a-4aa6-93bf-a47527fcec59', '3ee2e57c-d3e9-42cf-9a1d-bf2da58fe66f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:55 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:43:55 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:55 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Cloning volume c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 to volume f6352e00-fb7d-4a65-a3bf-da22465a7cb0 Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Creating offline snapshot 14c42a5e-8fb5-4dd3-953d-aeea836e3503 of volume c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b56c44-094a-4256-b5e8-c63b80633dd0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:56 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 Jul 11 18:43:56 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:57 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.763s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:57 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4dc53aa5-0caf-4d1c-be97-547c35d6a707 tempest-GroupsTest-874972503 None] Delete group completed successfully. Jul 11 18:43:57 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" returned: 0 in 1.486s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:57 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 1G Jul 11 18:43:57 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:58 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 1G" returned: 0 in 1.397s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:58 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 Jul 11 18:43:58 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:59 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503" returned: 0 in 1.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:59 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:59 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 Jul 11 18:43:59 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:00 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503" returned: 0 in 1.003s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:00 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.info Jul 11 18:44:00 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:02 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.info" returned: 0 in 1.095s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:02 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:02 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.info Jul 11 18:44:02 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:02 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.info" returned: 0 in 0.753s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Acquiring lock "cinder-quobyte-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Lock "cinder-quobyte-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] snapshot: 14c42a5e-8fb5-4dd3-953d-aeea836e3503, volume: f6352e00-fb7d-4a65-a3bf-da22465a7cb0, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0873a9-b712-4f25-bdb5-47ddb230864c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:02 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 Jul 11 18:44:02 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:03 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503" returned: 0 in 0.861s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:44:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:44:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ad1324-70b0-441a-8448-83904499e6b2]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:03 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 Jul 11 18:44:03 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:04 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" returned: 0 in 0.869s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:04 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:44:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:04 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 Jul 11 18:44:04 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:10 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=82,cinder:UPDATE=72,cinder:DELETE=3,cinder:INSERT=16 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:44:10 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=88,cinder:SELECT=70,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:44:11 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" returned: 0 in 6.674s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1394114-0d58-4618-9cbe-d2f5e8e3e0db]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:11 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 Jul 11 18:44:11 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:12 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" returned: 0 in 1.131s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:12 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:44:12 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Converted 1024.00 MB image at 153.40 MB/s Jul 11 18:44:12 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:44:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:12 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 Jul 11 18:44:12 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:13 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" returned: 0 in 0.750s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Lock "cinder-quobyte-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" released by "_copy_volume_from_snapshot" :: held 10.400s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Acquiring lock "cinder-quobyte-14c42a5e-8fb5-4dd3-953d-aeea836e3503" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Lock "cinder-quobyte-14c42a5e-8fb5-4dd3-953d-aeea836e3503" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Deleting offline snapshot 14c42a5e-8fb5-4dd3-953d-aeea836e3503 of volume c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] snapshot_file for this snap is: volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62e486-5f83-46d6-9fc2-10b0599502f9]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:13 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 Jul 11 18:44:13 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:14 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503" returned: 0 in 0.854s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[658eac74-2e61-4d7f-82b4-c0a6eef63c8a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:14 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 Jul 11 18:44:14 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Flow 'volume_create_manager' (b03cec3f-91d2-4db9-a00f-7d7fa0ea5b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85289a01-9da4-46c2-ad91-1d8eb9524a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85289a01-9da4-46c2-ad91-1d8eb9524a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1772043000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e2335b-541c-4c2f-a7c4-726d46f6842a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe15ef362514913a1085216b31d60a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:15Z,use_quota=True,user_id='ca743354abee40fbb98a9c020ed1d521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52c95db-eeaf-4467-8cb1-a5981d95d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52c95db-eeaf-4467-8cb1-a5981d95d519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c862e08-6a59-4fa6-95ec-23de4e3416fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c862e08-6a59-4fa6-95ec-23de4e3416fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e2335b-541c-4c2f-a7c4-726d46f6842a', 'volume_name': 'volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1c912f-c86e-4e18-9773-325b20df41b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1c912f-c86e-4e18-9773-325b20df41b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1e0c9b-f4e7-431a-8363-c5671f046d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Volume d7e2335b-541c-4c2f-a7c4-726d46f6842a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a', 'volume_size': 1} Jul 11 18:44:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:15 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" returned: 0 in 0.856s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:15 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:44:15 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:15 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 Jul 11 18:44:15 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:15 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.829s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:44:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:44:16 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503" returned: 0 in 0.983s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:16 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503 Jul 11 18:44:16 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:16 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4.14c42a5e-8fb5-4dd3-953d-aeea836e3503" returned: 0 in 0.659s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Lock "cinder-quobyte-14c42a5e-8fb5-4dd3-953d-aeea836e3503" released by "_delete_snapshot" :: held 3.462s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.993s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1772043000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e2335b-541c-4c2f-a7c4-726d46f6842a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe15ef362514913a1085216b31d60a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:15Z,use_quota=True,user_id='ca743354abee40fbb98a9c020ed1d521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Creating volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:16 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:44:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:16 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a 1073741824 Jul 11 18:44:16 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ecb7267e-34ed-4595-8675-02bc58e14be1 tempest-GroupsV314Test-1014437361 None] Create group from source-group-f22e3447-1b37-4ca7-8f19-e89cc2e01c71 completed successfully. Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Acquiring lock "cinder-quobyte-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Lock "cinder-quobyte-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9785e92e-6c57-45e4-81e2-93d1e8db9ba0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:18 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a 1073741824" returned: 0 in 1.386s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:18 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 Jul 11 18:44:18 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:18 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a Jul 11 18:44:18 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:18 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a" returned: 0 in 0.706s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:18 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1e0c9b-f4e7-431a-8363-c5671f046d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b1c291-c32d-440e-91e0-b343933debb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" returned: 0 in 0.889s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Volume volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a (d7e2335b-541c-4c2f-a7c4-726d46f6842a): created successfully Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b1c291-c32d-440e-91e0-b343933debb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:19 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0 Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Flow 'volume_create_manager' (b03cec3f-91d2-4db9-a00f-7d7fa0ea5b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:19 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b21e80f8-04b5-4453-9eb4-74cd203ac9a4 tempest-SnapshotsActionsTest-185074171 None] Created volume successfully. Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-f9a9c684-1059-4415-87e2-541c6f977b8e req-0e5efd28-95b5-472c-9a4f-22acacc23cc8 tempest-ServerActionsTestOtherA-1779163556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-f9a9c684-1059-4415-87e2-541c6f977b8e req-0e5efd28-95b5-472c-9a4f-22acacc23cc8 tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5200c0a2-b3ac-4b02-96d3-74cdec5095a2]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-f9a9c684-1059-4415-87e2-541c6f977b8e req-0e5efd28-95b5-472c-9a4f-22acacc23cc8 tempest-ServerActionsTestOtherA-1779163556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:19 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f Jul 11 18:44:19 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:19 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" returned: 0 in 0.899s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Lock "cinder-quobyte-f6352e00-fb7d-4a65-a3bf-da22465a7cb0" released by "delete_volume" :: held 1.857s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Created reservations ['7b7a546b-841a-4f83-88f1-2ea37db6c03a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:19 devstack cinder-volume[87167]: WARNING cinder.quota [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1300025267 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1300025267, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:44:19 devstack cinder-volume[87167]: WARNING cinder.quota [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1300025267 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1300025267, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Created reservations ['4657d895-038d-4c5b-a76a-69262acd00f1', 'cb92abed-e813-4597-bf15-8a4f7cf79d05', '587983ee-74a5-4992-a2bd-c4e13b635887', '8c31b807-9057-49eb-8dbc-1cac4b40a50e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:20 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:44:20 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:20 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-f9a9c684-1059-4415-87e2-541c6f977b8e req-0e5efd28-95b5-472c-9a4f-22acacc23cc8 tempest-ServerActionsTestOtherA-1779163556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f" returned: 0 in 0.884s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-f9a9c684-1059-4415-87e2-541c6f977b8e req-0e5efd28-95b5-472c-9a4f-22acacc23cc8 tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.905s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Creating offline snapshot 23abd653-3190-441d-b778-a4af9903b694 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef281e10-cfb5-4cbe-8e22-09f340b735c9]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-f9a9c684-1059-4415-87e2-541c6f977b8e req-0e5efd28-95b5-472c-9a4f-22acacc23cc8 tempest-ServerActionsTestOtherA-1779163556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '629278cf-ee5f-4710-8100-d49aad609286', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:44:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-f9a9c684-1059-4415-87e2-541c6f977b8e req-0e5efd28-95b5-472c-9a4f-22acacc23cc8 tempest-ServerActionsTestOtherA-1779163556 None] attachment_update completed successfully. Jul 11 18:44:20 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a Jul 11 18:44:20 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Acquiring lock "cinder-quobyte-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Lock "cinder-quobyte-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac65095-21ee-4755-b7e3-9d237c9cc816]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:21 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.149s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:21 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4924d51f-2fed-42b3-a709-05087bc5714f tempest-GroupsV314Test-1014437361 None] Delete group completed successfully. Jul 11 18:44:21 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 Jul 11 18:44:21 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:21 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a" returned: 0 in 1.254s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:21 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 1G Jul 11 18:44:21 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:22 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" returned: 0 in 1.100s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:22 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4 Jul 11 18:44:22 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:22 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 1G" returned: 0 in 1.257s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:23 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:23 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:23 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" returned: 0 in 1.050s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Lock "cinder-quobyte-c9c37cf3-f1b1-4f5b-94cd-061b677ebde4" released by "delete_volume" :: held 2.305s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Created reservations ['2b997d93-f40e-4ce6-97b9-2c8347d25046'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Created reservations ['5505b40e-632d-446e-a2f4-f53d59dc29f7', 'e6852aea-59fe-421b-8c72-bc29595144cb', 'd3bb762d-d02d-41cc-8a31-8cb99ec66957', 'b729c7e9-8c16-4877-b6b3-61df7bb6e6e8'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:23 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:44:23 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:24 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 1.041s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:24 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 is being set with open permissions: ugo+rw Jul 11 18:44:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:24 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:24 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:24 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.046s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:24 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6940cc48-d080-4e17-a23e-cafccc92fedd tempest-GroupsV314Test-1014437361 None] Delete group completed successfully. Jul 11 18:44:25 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 1.036s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:25 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.info Jul 11 18:44:25 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:25 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.info" returned: 0 in 0.838s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:25 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.info is being set with open permissions: ugo+rw Jul 11 18:44:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:26 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.info Jul 11 18:44:26 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:26 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.info" returned: 0 in 0.822s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.417s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-855f106f-c3fd-453b-a533-bdf1f9a3e77f tempest-SnapshotsActionsTest-185074171 None] Create snapshot completed successfully Jul 11 18:44:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Creating offline snapshot d9be859f-97d5-4e75-bd49-1bed65932838 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:44:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e18e45c-8f7a-45b0-ac67-2aa204fd4bf6]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:29 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:29 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-9bbed204-c275-457a-ae58-14ab44f82a04 tempest-ServerActionsTestOtherA-1779163556 None] Terminate volume connection completed successfully. Jul 11 18:44:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-9bbed204-c275-457a-ae58-14ab44f82a04 tempest-ServerActionsTestOtherA-1779163556 None] Deleting attachment 629278cf-ee5f-4710-8100-d49aad609286. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:44:29 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.994s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:29 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 1G Jul 11 18:44:29 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:30 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 1G" returned: 0 in 1.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:30 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 Jul 11 18:44:30 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:31 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838" returned: 0 in 1.068s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:31 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 is being set with open permissions: ugo+rw Jul 11 18:44:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:32 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 Jul 11 18:44:32 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-272d8f52-0d3c-4a27-ba7d-09bf44044d5e tempest-ServerActionsTestOtherA-1779163556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:32 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838" returned: 0 in 0.810s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.041s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-272d8f52-0d3c-4a27-ba7d-09bf44044d5e tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.575s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-73ae77d9-0d91-4d10-bc0c-9578e07b892f tempest-SnapshotsActionsTest-185074171 None] Create snapshot completed successfully Jul 11 18:44:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa4161b-a787-46be-a160-f261a7dd637c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-272d8f52-0d3c-4a27-ba7d-09bf44044d5e tempest-ServerActionsTestOtherA-1779163556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:32 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f Jul 11 18:44:32 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:33 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-272d8f52-0d3c-4a27-ba7d-09bf44044d5e tempest-ServerActionsTestOtherA-1779163556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f" returned: 0 in 0.757s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-272d8f52-0d3c-4a27-ba7d-09bf44044d5e tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-272d8f52-0d3c-4a27-ba7d-09bf44044d5e tempest-ServerActionsTestOtherA-1779163556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03aa5eba-6722-45c2-9fd0-81b678fa0da1', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:44:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-1d0497b7-4de7-4212-a137-39fe47e3b63f req-272d8f52-0d3c-4a27-ba7d-09bf44044d5e tempest-ServerActionsTestOtherA-1779163556 None] attachment_update completed successfully. Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-d9be859f-97d5-4e75-bd49-1bed65932838-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-d9be859f-97d5-4e75-bd49-1bed65932838-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-quobyte-d9be859f-97d5-4e75-bd49-1bed65932838" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d9be859f-97d5-4e75-bd49-1bed65932838" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Deleting offline snapshot d9be859f-97d5-4e75-bd49-1bed65932838 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] snapshot_file for this snap is: volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c76374d-ecfa-408f-a463-d692a9285cd4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:34 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 Jul 11 18:44:34 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:34 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838" returned: 0 in 0.820s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b5f417-7dd9-49c4-87dd-2b8470bc8a55]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:34 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:34 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:35 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.808s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:35 devstack sudo[91857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 Jul 11 18:44:35 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:36 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838" returned: 0 in 0.835s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:36 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838 Jul 11 18:44:36 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:37 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.d9be859f-97d5-4e75-bd49-1bed65932838" returned: 0 in 0.751s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d9be859f-97d5-4e75-bd49-1bed65932838" released by "_delete_snapshot" :: held 3.310s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" released by "delete_snapshot" :: held 3.339s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Created reservations ['c5475fcf-ee27-46d7-b937-3a733b2a33c3', '097711d9-d6bd-464d-92c5-1544757d315e', 'a215ccd2-bedc-4f72-b2d7-f905d5ba36d4', '602bdc3b-ecc6-47c2-a4d9-8bf0e29e54e4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Delete snapshot completed successfully. Jul 11 18:44:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2112fc-9764-4cdb-83b2-0c374df53f21 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-d9be859f-97d5-4e75-bd49-1bed65932838-delete_snapshot" released by "delete_snapshot" :: held 3.497s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Creating offline snapshot baabfec5-a5d8-4905-a9f3-28500c744962 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:44:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8317bf0-8638-43e2-91b6-2fe71cd6c25a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:38 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:38 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:39 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 1.121s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:39 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 1G Jul 11 18:44:39 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:40 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 1G" returned: 0 in 0.990s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:40 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 Jul 11 18:44:40 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Flow 'volume_create_manager' (66b12dcd-00c9-4ed6-8027-6b402966a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047f2b62-5b0c-4d3d-b3eb-a53ceda600b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047f2b62-5b0c-4d3d-b3eb-a53ceda600b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-304389250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55380056-21e4-41ca-992d-e545abed9260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e698a653e24233b491fe014ba4d6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:41Z,use_quota=True,user_id='39ecd2d513a1421999451a79971d631c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d8e378-5cb1-4f43-8350-6d3e2fb06db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d8e378-5cb1-4f43-8350-6d3e2fb06db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0982749-9826-487f-b021-87d0a8b7ae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0982749-9826-487f-b021-87d0a8b7ae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55380056-21e4-41ca-992d-e545abed9260', 'volume_name': 'volume-55380056-21e4-41ca-992d-e545abed9260', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741b4ff0-d751-4df2-b250-2d1fd979feab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741b4ff0-d751-4df2-b250-2d1fd979feab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c28900-b25f-4e23-9f8a-61e3d1a7bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Volume 55380056-21e4-41ca-992d-e545abed9260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55380056-21e4-41ca-992d-e545abed9260', 'volume_size': 1} Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:41 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962" returned: 0 in 0.911s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:41 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 is being set with open permissions: ugo+rw Jul 11 18:44:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:41 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 Jul 11 18:44:41 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:42 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.827s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-304389250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55380056-21e4-41ca-992d-e545abed9260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e698a653e24233b491fe014ba4d6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:41Z,use_quota=True,user_id='39ecd2d513a1421999451a79971d631c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Creating volume 55380056-21e4-41ca-992d-e545abed9260 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:42 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:42 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 1073741824 Jul 11 18:44:42 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ca74d986-6313-4c5e-be07-6a115a2bf8fa tempest-SnapshotsActionsTest-185074171 None] Create snapshot completed successfully Jul 11 18:44:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-baabfec5-a5d8-4905-a9f3-28500c744962-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-baabfec5-a5d8-4905-a9f3-28500c744962-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-quobyte-baabfec5-a5d8-4905-a9f3-28500c744962" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-baabfec5-a5d8-4905-a9f3-28500c744962" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Deleting offline snapshot baabfec5-a5d8-4905-a9f3-28500c744962 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] snapshot_file for this snap is: volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd9bae8-4154-49b5-858e-863c73f3dc64]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:43 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 Jul 11 18:44:43 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:43 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 1073741824" returned: 0 in 1.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:43 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 Jul 11 18:44:43 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:44 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962" returned: 0 in 1.088s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Flow 'volume_create_manager' (55e9440f-ee76-48af-af64-ddcfb887a20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e949f22-0c21-42df-bdc9-1458c6d3577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9128b5e1-f8ff-419b-8b6c-1f080401afff]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e949f22-0c21-42df-bdc9-1458c6d3577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-628243055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ed1763-0678-47c2-8051-49cc878d9848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ae0d49051d4076b664d5abbc5a0cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:44Z,use_quota=True,user_id='1d9497e876124ce594a6f61a9d049e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37f8aa0-6cc6-45aa-b374-666048c3e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37f8aa0-6cc6-45aa-b374-666048c3e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40639c14-ba1f-46db-9a24-064b3d52ecf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40639c14-ba1f-46db-9a24-064b3d52ecf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ed1763-0678-47c2-8051-49cc878d9848', 'volume_name': 'volume-97ed1763-0678-47c2-8051-49cc878d9848', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4dc3b2-f8e7-4900-b4f2-eff399a5f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4dc3b2-f8e7-4900-b4f2-eff399a5f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b94736-27b8-4323-b4e0-40dfad3b7720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:44 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Volume 97ed1763-0678-47c2-8051-49cc878d9848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ed1763-0678-47c2-8051-49cc878d9848', 'volume_size': 1} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:44 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260" returned: 0 in 0.755s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.040s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-628243055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ed1763-0678-47c2-8051-49cc878d9848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ae0d49051d4076b664d5abbc5a0cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:44Z,use_quota=True,user_id='1d9497e876124ce594a6f61a9d049e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Creating volume 97ed1763-0678-47c2-8051-49cc878d9848 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:44 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:44 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:44 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c28900-b25f-4e23-9f8a-61e3d1a7bc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55380056-21e4-41ca-992d-e545abed9260', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d4f5ba-24f4-4cae-bb60-b6a05c260bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:44 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 1073741824 Jul 11 18:44:44 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Volume volume-55380056-21e4-41ca-992d-e545abed9260 (55380056-21e4-41ca-992d-e545abed9260): created successfully Jul 11 18:44:44 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d4f5ba-24f4-4cae-bb60-b6a05c260bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Flow 'volume_create_manager' (66b12dcd-00c9-4ed6-8027-6b402966a313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8f2907a3-015f-421b-b32a-4fef389ad793 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Created volume successfully. Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Acquiring lock "cinder-55380056-21e4-41ca-992d-e545abed9260-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "cinder-55380056-21e4-41ca-992d-e545abed9260-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Acquiring lock "cinder-quobyte-55380056-21e4-41ca-992d-e545abed9260" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "cinder-quobyte-55380056-21e4-41ca-992d-e545abed9260" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1c27da-3541-4edd-b08b-e235f5603df5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:45 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 Jul 11 18:44:45 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:45 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 1.037s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:45 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 Jul 11 18:44:45 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:45 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 1073741824" returned: 0 in 1.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:45 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 Jul 11 18:44:45 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:45 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260" returned: 0 in 0.879s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:45 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260 Jul 11 18:44:45 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:46 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848" returned: 0 in 0.823s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b94736-27b8-4323-b4e0-40dfad3b7720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ed1763-0678-47c2-8051-49cc878d9848', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077c885a-71a0-4293-b484-a6b348c50200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:46 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Volume volume-97ed1763-0678-47c2-8051-49cc878d9848 (97ed1763-0678-47c2-8051-49cc878d9848): created successfully Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077c885a-71a0-4293-b484-a6b348c50200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Flow 'volume_create_manager' (55e9440f-ee76-48af-af64-ddcfb887a20a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962" returned: 0 in 1.031s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1c717060-076c-423f-b922-f69abcce8e4c tempest-AttachVolumeShelveTestJSON-425378299 None] Created volume successfully. Jul 11 18:44:46 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962 Jul 11 18:44:46 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:46 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-55380056-21e4-41ca-992d-e545abed9260" returned: 0 in 0.731s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "cinder-quobyte-55380056-21e4-41ca-992d-e545abed9260" released by "delete_volume" :: held 1.663s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Created reservations ['3f3315f8-0828-42b5-b14e-62fbf50486a9', '23a38de3-4a8d-4411-b34b-55c0cd1f93de', '5be1cfb2-9a47-4c9a-b26d-41cfd1e6e240', 'f42fe81d-5d58-49f3-849a-1df90fec13c6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:46 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:44:46 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:46 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.baabfec5-a5d8-4905-a9f3-28500c744962" returned: 0 in 0.687s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-baabfec5-a5d8-4905-a9f3-28500c744962" released by "_delete_snapshot" :: held 4.006s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" released by "delete_snapshot" :: held 4.033s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Created reservations ['93e14286-b5ad-4f72-ad8d-15faf22cc9a9', 'ac671622-d2aa-4cc7-8b35-926e4339ce7e', 'bfc330fb-f27e-4ee8-8a29-686a36187820', '4fd8a195-2cb3-484a-bf61-d6242d3cc6cd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Delete snapshot completed successfully. Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1a2352d5-1471-48dd-b953-ebf1303b0717 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-baabfec5-a5d8-4905-a9f3-28500c744962-delete_snapshot" released by "delete_snapshot" :: held 4.232s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:47 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.824s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Deleted volume successfully. Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2a01082-5195-4c67-9cb4-96b931879258 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "cinder-55380056-21e4-41ca-992d-e545abed9260-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Flow 'volume_create_manager' (05b2bd39-ce66-4ed2-9e2f-7cda66bde5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e71b1e-1542-4f8b-8a90-90155bb95b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e71b1e-1542-4f8b-8a90-90155bb95b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-485067622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad05413f-4db7-4a6b-9ce6-fd4dade51a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e698a653e24233b491fe014ba4d6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:48Z,use_quota=True,user_id='39ecd2d513a1421999451a79971d631c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683cb930-c483-4056-b583-3f3eeb4daea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683cb930-c483-4056-b583-3f3eeb4daea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcd4989-26e2-41f4-a2af-1bd7ad124593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcd4989-26e2-41f4-a2af-1bd7ad124593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad05413f-4db7-4a6b-9ce6-fd4dade51a76', 'volume_name': 'volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75406f93-f718-4151-a568-039c65513467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75406f93-f718-4151-a568-039c65513467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a305a710-e9ca-44bb-9b68-718a710d4bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Volume ad05413f-4db7-4a6b-9ce6-fd4dade51a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76', 'volume_size': 1} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Creating offline snapshot 5377abb6-1c2b-4e54-ab36-e236b596f9d3 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[249ee2e2-93cc-4844-acf5-5d6fbdb02a90]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:48 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:48 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:48 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.872s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:49 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 1G Jul 11 18:44:49 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:49 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 1G" returned: 0 in 0.856s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:49 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 Jul 11 18:44:49 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:50 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3" returned: 0 in 0.742s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:50 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 is being set with open permissions: ugo+rw Jul 11 18:44:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:50 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 Jul 11 18:44:50 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:51 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3" returned: 0 in 0.650s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.275s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.228s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-485067622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad05413f-4db7-4a6b-9ce6-fd4dade51a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e698a653e24233b491fe014ba4d6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:48Z,use_quota=True,user_id='39ecd2d513a1421999451a79971d631c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Creating volume ad05413f-4db7-4a6b-9ce6-fd4dade51a76 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:51 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:44:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:51 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 1073741824 Jul 11 18:44:51 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4d247e37-aff8-495e-ad3e-ded2bafe92b6 tempest-SnapshotsActionsTest-185074171 None] Create snapshot completed successfully Jul 11 18:44:52 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 1073741824" returned: 0 in 0.897s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-5377abb6-1c2b-4e54-ab36-e236b596f9d3-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-5377abb6-1c2b-4e54-ab36-e236b596f9d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-quobyte-5377abb6-1c2b-4e54-ab36-e236b596f9d3" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:52 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 Jul 11 18:44:52 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-5377abb6-1c2b-4e54-ab36-e236b596f9d3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Deleting offline snapshot 5377abb6-1c2b-4e54-ab36-e236b596f9d3 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] snapshot_file for this snap is: volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938863f-302d-4628-a51d-18c4eee52cc8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:52 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 Jul 11 18:44:52 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:53 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76" returned: 0 in 0.881s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a305a710-e9ca-44bb-9b68-718a710d4bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e610c3-bce4-4836-b4b0-dcf87726fe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:53 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Volume volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 (ad05413f-4db7-4a6b-9ce6-fd4dade51a76): created successfully Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e610c3-bce4-4836-b4b0-dcf87726fe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Flow 'volume_create_manager' (05b2bd39-ce66-4ed2-9e2f-7cda66bde5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0328055f-138b-484c-b667-1600cff69954 tempest-VolumeQuotasAdminTestJSON-1623402277 None] Created volume successfully. Jul 11 18:44:53 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3" returned: 0 in 1.058s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[69411765-dc3d-4c7d-ba38-5935a958bd18]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:53 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:53 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:54 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.783s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:54 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 Jul 11 18:44:54 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-59792001-5143-4811-b605-eba7853266e2 tempest-VolumeQuotasAdminTestJSON-800377237 None] Transfer volume completed successfully. Jul 11 18:44:55 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3" returned: 0 in 0.910s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:55 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3 Jul 11 18:44:55 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:55 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.5377abb6-1c2b-4e54-ab36-e236b596f9d3" returned: 0 in 0.739s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-5377abb6-1c2b-4e54-ab36-e236b596f9d3" released by "_delete_snapshot" :: held 3.620s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" released by "delete_snapshot" :: held 3.650s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Created reservations ['ff33ee36-ef24-462b-b438-97305624ad4e', 'c667dcf1-03f4-402a-b0e2-9b7154a5255b', '9646d628-6b87-42d4-96cd-71bb426892c0', '126dd897-682f-4a9f-9639-1da6dfec4939'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Acquiring lock "cinder-ad05413f-4db7-4a6b-9ce6-fd4dade51a76-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Lock "cinder-ad05413f-4db7-4a6b-9ce6-fd4dade51a76-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Delete snapshot completed successfully. Jul 11 18:44:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8053d830-53f2-4e5c-996b-c519a9bfe854 tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-5377abb6-1c2b-4e54-ab36-e236b596f9d3-delete_snapshot" released by "delete_snapshot" :: held 3.851s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Acquiring lock "cinder-quobyte-ad05413f-4db7-4a6b-9ce6-fd4dade51a76" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Lock "cinder-quobyte-ad05413f-4db7-4a6b-9ce6-fd4dade51a76" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d9feff-bc3c-4a1f-a6a7-252e0f645fd5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:56 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 Jul 11 18:44:56 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Creating offline snapshot 625a96a1-b927-4230-9939-2b9fc498d814 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:44:57 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76" returned: 0 in 0.915s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bac3077-467a-49e5-b3b9-5bb0c6d2a352]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:57 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76 Jul 11 18:44:57 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:57 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:44:57 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:57 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad05413f-4db7-4a6b-9ce6-fd4dade51a76" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Lock "cinder-quobyte-ad05413f-4db7-4a6b-9ce6-fd4dade51a76" released by "delete_volume" :: held 1.673s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Created reservations ['b8c09d88-7eed-4487-ad19-832758c4721c', '1ffce0ab-17f0-4376-91d0-1f9f5c58d385', 'd6e1f559-94b8-49e2-bf37-71ed84ab8249', '21189bd2-77db-4184-8fd4-7ffa876d94f3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:57 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.806s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:57 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 1G Jul 11 18:44:57 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:57 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:44:57 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:58 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.818s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:58 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Deleted volume successfully. Jul 11 18:44:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ba48d71-3920-46fa-a6d1-914e2a67c68f tempest-VolumeQuotasAdminTestJSON-2109231177 None] Lock "cinder-ad05413f-4db7-4a6b-9ce6-fd4dade51a76-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:58 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 1G" returned: 0 in 1.060s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:59 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 Jul 11 18:44:59 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:00 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814" returned: 0 in 1.049s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 is being set with open permissions: ugo+rw Jul 11 18:45:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:00 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 Jul 11 18:45:00 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:00 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814" returned: 0 in 0.809s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.891s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-978643bf-6ba2-4da7-90a9-a839263a521b tempest-SnapshotsActionsTest-185074171 None] Create snapshot completed successfully Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-625a96a1-b927-4230-9939-2b9fc498d814-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-625a96a1-b927-4230-9939-2b9fc498d814-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Acquiring lock "cinder-quobyte-625a96a1-b927-4230-9939-2b9fc498d814" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-625a96a1-b927-4230-9939-2b9fc498d814" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Deleting offline snapshot 625a96a1-b927-4230-9939-2b9fc498d814 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] snapshot_file for this snap is: volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d27360-ce54-4435-9e37-273de01809a6]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:02 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 Jul 11 18:45:02 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:02 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814" returned: 0 in 1.134s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf9b22-d09f-405b-b5ab-a1c2f5ab2100]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:03 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:45:03 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-bde545ee-aeda-4eab-9842-ccf927ec47ad req-9868f2d1-fd66-44a1-b73b-8466316a2cc2 tempest-AttachVolumeShelveTestJSON-425378299 None] No connector for attachment ec4fd002-4361-4746-abf4-2d3aff5c2e04; skipping storage backend terminate_connection call. {{(pid=87167) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 11 18:45:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-bde545ee-aeda-4eab-9842-ccf927ec47ad req-9868f2d1-fd66-44a1-b73b-8466316a2cc2 tempest-AttachVolumeShelveTestJSON-425378299 None] Deleting attachment ec4fd002-4361-4746-abf4-2d3aff5c2e04. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:45:04 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.969s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:04 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 Jul 11 18:45:04 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-2fe9b72f-ee72-4345-9245-2056b8842cef req-618c3243-0d76-4c95-b28c-080049506ee2 tempest-ServerActionsTestOtherA-1779163556 None] Terminate volume connection completed successfully. Jul 11 18:45:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-2fe9b72f-ee72-4345-9245-2056b8842cef req-618c3243-0d76-4c95-b28c-080049506ee2 tempest-ServerActionsTestOtherA-1779163556 None] Deleting attachment 03aa5eba-6722-45c2-9fd0-81b678fa0da1. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:45:05 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814" returned: 0 in 1.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:05 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814 Jul 11 18:45:05 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:05 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.625a96a1-b927-4230-9939-2b9fc498d814" returned: 0 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-625a96a1-b927-4230-9939-2b9fc498d814" released by "_delete_snapshot" :: held 4.004s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" released by "delete_snapshot" :: held 4.031s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Created reservations ['2f27949c-96ed-4672-a909-fa959a036744', '00f2d1a9-68d4-4856-ab8a-d8eb5b4597da', '677c8c3a-bd4e-45c2-abfa-bce1e430402c', 'e3067175-1b51-4231-b344-ff1392955941'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Delete snapshot completed successfully. Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a14ca2b7-adfd-4433-891c-248422140fab tempest-SnapshotsActionsTest-1601046017 None] Lock "cinder-625a96a1-b927-4230-9939-2b9fc498d814-delete_snapshot" released by "delete_snapshot" :: held 4.230s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "cinder-23abd653-3190-441d-b778-a4af9903b694-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-23abd653-3190-441d-b778-a4af9903b694-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "cinder-quobyte-23abd653-3190-441d-b778-a4af9903b694" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-quobyte-23abd653-3190-441d-b778-a4af9903b694" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Deleting offline snapshot 23abd653-3190-441d-b778-a4af9903b694 of volume d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] snapshot_file for this snap is: volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a173a-a8aa-4796-af2a-2fc7faf3e09a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:06 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:45:06 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:07 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Flow 'volume_create_manager' (1de2411c-af0d-469c-aac6-4f7ba6110ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b54d15b-606d-40cc-a79d-a722a374cb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.976s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b54d15b-606d-40cc-a79d-a722a374cb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1583654688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e240d3f-c696-4a2f-98e8-650e94efbb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8970e12bfaaf4a3c810e09f7b91a416d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:08Z,use_quota=True,user_id='bf1c62ed3bc846bdac750dbb62d444ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba211f7-c515-4ef2-94dd-7d7c978c1a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba211f7-c515-4ef2-94dd-7d7c978c1a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67803fd-4281-44b4-aaf8-8df1fa3ce56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67803fd-4281-44b4-aaf8-8df1fa3ce56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e240d3f-c696-4a2f-98e8-650e94efbb9f', 'volume_name': 'volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fc6164-3e81-486e-ac44-6e36aeb6aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fc6164-3e81-486e-ac44-6e36aeb6aa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9fc1af-14f7-452d-b537-5cb0831477fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Volume 7e240d3f-c696-4a2f-98e8-650e94efbb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f', 'volume_size': 1} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1583654688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e240d3f-c696-4a2f-98e8-650e94efbb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8970e12bfaaf4a3c810e09f7b91a416d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:08Z,use_quota=True,user_id='bf1c62ed3bc846bdac750dbb62d444ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Creating volume 7e240d3f-c696-4a2f-98e8-650e94efbb9f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec57544-b33b-4412-a70c-0450a613cbe4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:07 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f 1073741824 Jul 11 18:45:07 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:07 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a Jul 11 18:45:07 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:08 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a" returned: 0 in 0.829s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:08 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:45:08 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:08 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f 1073741824" returned: 0 in 0.909s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:08 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f Jul 11 18:45:08 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:09 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.989s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:09 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f" returned: 0 in 0.925s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:09 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694 Jul 11 18:45:09 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9fc1af-14f7-452d-b537-5cb0831477fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb820ef2-bfba-42b1-a582-ed8d41dbfb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Volume volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f (7e240d3f-c696-4a2f-98e8-650e94efbb9f): created successfully Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb820ef2-bfba-42b1-a582-ed8d41dbfb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Flow 'volume_create_manager' (1de2411c-af0d-469c-aac6-4f7ba6110ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2d6662d7-b815-4fc1-b9d3-38baffd852f7 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Created volume successfully. Jul 11 18:45:10 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a.23abd653-3190-441d-b778-a4af9903b694" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-quobyte-23abd653-3190-441d-b778-a4af9903b694" released by "_delete_snapshot" :: held 3.690s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" released by "delete_snapshot" :: held 3.731s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Created reservations ['678f8408-25b3-4034-98b6-b762f8bff5dc', 'f1fb5fdf-4882-4acb-b6c4-b8c09720e3eb', '1cc51d7b-ca0e-4b49-a8cf-c8c50737ee61', 'cfd4ff88-d8ec-47aa-b0da-8a5d89fba9ee'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Delete snapshot completed successfully. Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-536b2f35-5e2f-4e53-8015-a429e14839b7 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-23abd653-3190-441d-b778-a4af9903b694-delete_snapshot" released by "delete_snapshot" :: held 3.927s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "cinder-d7e2335b-541c-4c2f-a7c4-726d46f6842a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-d7e2335b-541c-4c2f-a7c4-726d46f6842a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d1483a-b4bf-4388-b1a7-bdfdd1a67319]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:11 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a Jul 11 18:45:11 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Acquiring lock "cinder-7e240d3f-c696-4a2f-98e8-650e94efbb9f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:11 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a" returned: 0 in 0.845s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "cinder-7e240d3f-c696-4a2f-98e8-650e94efbb9f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=98,cinder:SELECT=93,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:45:11 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=89,cinder:UPDATE=87,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:45:11 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Acquiring lock "cinder-quobyte-7e240d3f-c696-4a2f-98e8-650e94efbb9f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "cinder-quobyte-7e240d3f-c696-4a2f-98e8-650e94efbb9f" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac037ad-ec0d-4e21-b3b7-c574d527218c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:12 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f Jul 11 18:45:12 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:12 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d7e2335b-541c-4c2f-a7c4-726d46f6842a" returned: 0 in 0.749s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-quobyte-d7e2335b-541c-4c2f-a7c4-726d46f6842a" released by "delete_volume" :: held 1.678s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Created reservations ['71c27823-8459-4088-92f3-b7818a161df2', '67244f82-f326-4b34-ab99-766fa1145cc7', '66b52411-b90b-444e-b88a-bfcb9381b6f9', '8b0900cf-fb6f-4210-b6b4-dc5caf217cae'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:12 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:12 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:12 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f" returned: 0 in 0.935s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:12 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f Jul 11 18:45:12 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:13 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.894s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:13 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Deleted volume successfully. Jul 11 18:45:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5a21ce1f-c75b-4d3f-8061-298f98ed5f18 tempest-SnapshotsActionsTest-185074171 None] Lock "cinder-d7e2335b-541c-4c2f-a7c4-726d46f6842a-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:13 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7e240d3f-c696-4a2f-98e8-650e94efbb9f" returned: 0 in 0.966s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "cinder-quobyte-7e240d3f-c696-4a2f-98e8-650e94efbb9f" released by "delete_volume" :: held 1.948s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Created reservations ['2dc2d37b-68b6-4133-b0f0-023005d4a7a3', 'ff313766-2339-404d-844f-5d8ae06a5033', '021c5845-7011-436f-97e7-0dd05341f1d0', '73c2fdaa-60ad-4a9a-b00f-075710a20473'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:14 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:14 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:14 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.942s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Deleted volume successfully. Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-76c47805-ecb8-435e-a795-b941c8842775 tempest-VolumeQuotasNegativeTestJSON-1099383565 None] Lock "cinder-7e240d3f-c696-4a2f-98e8-650e94efbb9f-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:15 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:15 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:15 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.790s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:45:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:45:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Acquiring lock "cinder-64ee7ef7-9e53-4a99-8501-cf5c8508384f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Lock "cinder-64ee7ef7-9e53-4a99-8501-cf5c8508384f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Acquiring lock "cinder-quobyte-64ee7ef7-9e53-4a99-8501-cf5c8508384f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Lock "cinder-quobyte-64ee7ef7-9e53-4a99-8501-cf5c8508384f" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[752f4908-4474-4139-80e9-f512b0b1d985]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:16 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f Jul 11 18:45:16 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:17 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f" returned: 0 in 1.181s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:17 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f Jul 11 18:45:17 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:18 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-64ee7ef7-9e53-4a99-8501-cf5c8508384f" returned: 0 in 0.935s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Lock "cinder-quobyte-64ee7ef7-9e53-4a99-8501-cf5c8508384f" released by "delete_volume" :: held 2.200s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Created reservations ['24b79f5a-b2bd-41cc-ae71-a4074a4cfcd7', 'fb9ba671-64f4-47d8-8b5d-e88b7478b17f', 'c62959bb-c40f-405a-ab90-66e236a4ac62', '9ff033ef-2490-43cf-82a0-61a58d8eb125'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:18 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:18 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:19 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.706s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Deleted volume successfully. Jul 11 18:45:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d36f16cb-ddd0-47b0-bd05-f0754c1e38b2 tempest-ServerActionsTestOtherA-1779163556 None] Lock "cinder-64ee7ef7-9e53-4a99-8501-cf5c8508384f-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:22 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Flow 'volume_create_manager' (e0866760-02cd-4f03-9831-dc364e480949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20193402-711c-45f6-823d-22fd55f326d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20193402-711c-45f6-823d-22fd55f326d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-972271151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3751ef-5f61-4974-8615-9c100d908945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e939d9da054bd88c8e6aa73e6ccd6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:23Z,use_quota=True,user_id='e41e59a54e8d4f88a6c454372e0b4bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfbc86b-069d-4f03-942b-7ca33879d25c),volume_type_id=bbfbc86b-069d-4f03-942b-7ca33879d25c)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713e6e60-c78b-4410-acfe-c3c07ebbee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713e6e60-c78b-4410-acfe-c3c07ebbee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61a1a25-8a56-4fad-ac62-801b74b6a291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61a1a25-8a56-4fad-ac62-801b74b6a291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3751ef-5f61-4974-8615-9c100d908945', 'volume_name': 'volume-5b3751ef-5f61-4974-8615-9c100d908945', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66794e61-08ad-4af1-8300-c86b955d9824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66794e61-08ad-4af1-8300-c86b955d9824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc006d9-2574-4eb0-9756-8285dada2a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Volume 5b3751ef-5f61-4974-8615-9c100d908945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3751ef-5f61-4974-8615-9c100d908945', 'volume_size': 1} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-972271151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3751ef-5f61-4974-8615-9c100d908945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e939d9da054bd88c8e6aa73e6ccd6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:23Z,use_quota=True,user_id='e41e59a54e8d4f88a6c454372e0b4bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfbc86b-069d-4f03-942b-7ca33879d25c),volume_type_id=bbfbc86b-069d-4f03-942b-7ca33879d25c)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Creating volume 5b3751ef-5f61-4974-8615-9c100d908945 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:23 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:45:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:23 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 1073741824 Jul 11 18:45:23 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:24 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 1073741824" returned: 0 in 1.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:24 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 Jul 11 18:45:24 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:25 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945" returned: 0 in 0.760s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc006d9-2574-4eb0-9756-8285dada2a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3751ef-5f61-4974-8615-9c100d908945', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14639a58-8202-4c12-b407-5b161a5b98a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Volume volume-5b3751ef-5f61-4974-8615-9c100d908945 (5b3751ef-5f61-4974-8615-9c100d908945): created successfully Jul 11 18:45:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14639a58-8202-4c12-b407-5b161a5b98a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Flow 'volume_create_manager' (e0866760-02cd-4f03-9831-dc364e480949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-16a84d93-20a2-4070-8960-7d5797f80011 tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Created volume successfully. Jul 11 18:45:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:26 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:26 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Flow 'volume_create_manager' (fe995fcf-b9c2-4b3b-9283-6c066d00ccae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c4b13c-9245-46b5-a507-7c31615febca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c4b13c-9245-46b5-a507-7c31615febca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1955123352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea797a9-22cf-45a3-bb50-6baae4194437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ad4a45e31941ee8d504d9ca45b75d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:27Z,use_quota=True,user_id='94f82c15c264444f9513c7689692d0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19488a4-67d7-4b7d-8570-0362d45fd575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19488a4-67d7-4b7d-8570-0362d45fd575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805f0f2b-49f4-48f8-a415-038bb9a9aef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:45:27 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.142s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c19da215-47d9-4927-b6f7-e8b2c9a0f76e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Retype volume completed successfully. Jul 11 18:45:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Acquiring lock "cinder-5b3751ef-5f61-4974-8615-9c100d908945-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "cinder-5b3751ef-5f61-4974-8615-9c100d908945-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Acquiring lock "cinder-quobyte-5b3751ef-5f61-4974-8615-9c100d908945" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "cinder-quobyte-5b3751ef-5f61-4974-8615-9c100d908945" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f77394c-8e99-4494-a58a-6c5a20650d25]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805f0f2b-49f4-48f8-a415-038bb9a9aef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ea797a9-22cf-45a3-bb50-6baae4194437', 'volume_name': 'volume-7ea797a9-22cf-45a3-bb50-6baae4194437', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0544783c-c72c-45b0-b325-47c33d721505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0544783c-c72c-45b0-b325-47c33d721505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11be6d22-4550-4b24-86da-289165853e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Volume 7ea797a9-22cf-45a3-bb50-6baae4194437: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ea797a9-22cf-45a3-bb50-6baae4194437', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:45:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Trying to clone 7ea797a9-22cf-45a3-bb50-6baae4194437 from image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:45:28 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 Jul 11 18:45:28 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:29 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:45:29 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:45:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfc90f8-802f-4915-8116-2f5f18cbe9fb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:29 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD Jul 11 18:45:29 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:29 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945" returned: 0 in 1.194s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:29 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945 Jul 11 18:45:29 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:30 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5b3751ef-5f61-4974-8615-9c100d908945" returned: 0 in 0.740s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "cinder-quobyte-5b3751ef-5f61-4974-8615-9c100d908945" released by "delete_volume" :: held 2.003s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:30 devstack cinder-volume[87167]: WARNING cinder.quota [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:45:30 devstack cinder-volume[87167]: WARNING cinder.quota [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:45:30 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD" returned: 0 in 1.000s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Temporary image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 is fetched for user 94f82c15c264444f9513c7689692d0c5. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Created reservations ['2a6b484d-afde-4d6f-beaa-2691ce45b20e', '9e7cd5f8-3e10-4765-b5de-c5c126bb320e', '54a4d2a4-660e-4c50-8e30-a2a9792a9469', '72485920-b653-440c-95ef-d37f2485155b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[50940894-d8d3-4172-809d-beaa08332795]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:30 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:30 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:30 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD Jul 11 18:45:30 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:31 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD" returned: 0 in 1.039s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1955123352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea797a9-22cf-45a3-bb50-6baae4194437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ad4a45e31941ee8d504d9ca45b75d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:27Z,use_quota=True,user_id='94f82c15c264444f9513c7689692d0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Creating volume 7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:31 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 1073741824 Jul 11 18:45:31 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:31 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.272s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Deleted volume successfully. Jul 11 18:45:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2e55d3a7-30c4-4282-9eb7-7a1cc1e2715e tempest-VolumeRetypeWithoutMigrationTest-1277683364 None] Lock "cinder-5b3751ef-5f61-4974-8615-9c100d908945-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:32 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 1073741824" returned: 0 in 1.196s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:32 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 Jul 11 18:45:32 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:33 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437" returned: 0 in 0.870s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:33 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Attempting download of 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}])) to volume 7ea797a9-22cf-45a3-bb50-6baae4194437. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:45:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e102f-437e-4a2b-b880-d3ee08dab4c5]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_9qeejjae {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:33 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_9qeejjae Jul 11 18:45:33 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:34 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_9qeejjae" returned: 0 in 1.056s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_9qeejjae {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:34 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_9qeejjae Jul 11 18:45:34 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:35 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_9qeejjae" returned: 1 in 0.884s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_9qeejjae' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:45:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceefe3bf-51fb-41bc-88da-3fabd0882e40]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:35 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD Jul 11 18:45:35 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:36 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD" returned: 0 in 0.885s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:36 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 was qcow2, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:45:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:36 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 Jul 11 18:45:36 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Flow 'volume_create_manager' (90a2af9d-3e7c-4919-a6ae-8841e45060dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca0e24d-cb40-4148-aff0-fdef92261e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca0e24d-cb40-4148-aff0-fdef92261e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-657413649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a57299-6146-4aaf-864d-9877463d7e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0cce98829d6423ea279c6a98afc8048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:39Z,use_quota=True,user_id='33d42a4128b44e028e1b3894c43f33a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddcf897-5317-40ad-978d-8e6619c0588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddcf897-5317-40ad-978d-8e6619c0588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26983cd4-1a92-4722-8759-38185f53f8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26983cd4-1a92-4722-8759-38185f53f8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a57299-6146-4aaf-864d-9877463d7e4d', 'volume_name': 'volume-85a57299-6146-4aaf-864d-9877463d7e4d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fdaa07-6cf4-4ed1-b9c0-0fbcbe27753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fdaa07-6cf4-4ed1-b9c0-0fbcbe27753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1dea78-20f9-4113-85c4-6f648467637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Volume 85a57299-6146-4aaf-864d-9877463d7e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a57299-6146-4aaf-864d-9877463d7e4d', 'volume_size': 1} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-657413649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a57299-6146-4aaf-864d-9877463d7e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0cce98829d6423ea279c6a98afc8048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:39Z,use_quota=True,user_id='33d42a4128b44e028e1b3894c43f33a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Creating volume 85a57299-6146-4aaf-864d-9877463d7e4d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:39 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:45:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:39 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d 1073741824 Jul 11 18:45:39 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:39 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437" returned: 0 in 2.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:39 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_8gzatvt9devstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:45:39 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Converted 112.00 MB image at 42.31 MB/s Jul 11 18:45:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:39 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 1G Jul 11 18:45:39 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:40 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 1G" returned: 0 in 0.901s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e735c0-12c9-4f4a-828a-f42bfdb3536e]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:40 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d 1073741824" returned: 0 in 1.093s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:40 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 Jul 11 18:45:40 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:40 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d Jul 11 18:45:40 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:40 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d" returned: 0 in 0.686s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1dea78-20f9-4113-85c4-6f648467637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a57299-6146-4aaf-864d-9877463d7e4d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8d028d-f75a-4299-ab14-4584de94a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Volume volume-85a57299-6146-4aaf-864d-9877463d7e4d (85a57299-6146-4aaf-864d-9877463d7e4d): created successfully Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8d028d-f75a-4299-ab14-4584de94a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Flow 'volume_create_manager' (90a2af9d-3e7c-4919-a6ae-8841e45060dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-606e95dd-43f1-4ecd-b0c0-50389a004480 tempest-VolumesServicesTestJSON-97286083 None] Created volume successfully. Jul 11 18:45:40 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437" returned: 0 in 0.887s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:41 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 Jul 11 18:45:41 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:41 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437" returned: 1 in 0.745s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Downloaded image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}])) to volume 7ea797a9-22cf-45a3-bb50-6baae4194437 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Temporary image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 for user 94f82c15c264444f9513c7689692d0c5 is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Marking volume 7ea797a9-22cf-45a3-bb50-6baae4194437 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Copying metadata from image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 to 7ea797a9-22cf-45a3-bb50-6baae4194437. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Creating volume glance metadata for volume 7ea797a9-22cf-45a3-bb50-6baae4194437 backed by image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11be6d22-4550-4b24-86da-289165853e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea797a9-22cf-45a3-bb50-6baae4194437', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac6bb55-709a-444f-b1c7-932e9f171fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Volume volume-7ea797a9-22cf-45a3-bb50-6baae4194437 (7ea797a9-22cf-45a3-bb50-6baae4194437): created successfully Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac6bb55-709a-444f-b1c7-932e9f171fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Flow 'volume_create_manager' (fe995fcf-b9c2-4b3b-9283-6c066d00ccae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-495fe54e-1069-41ab-97b5-7ef38e51fc6a tempest-VolumesImageMetadata-1147441597 None] Created volume successfully. Jul 11 18:45:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Acquiring lock "cinder-85a57299-6146-4aaf-864d-9877463d7e4d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Lock "cinder-85a57299-6146-4aaf-864d-9877463d7e4d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Acquiring lock "cinder-quobyte-85a57299-6146-4aaf-864d-9877463d7e4d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Lock "cinder-quobyte-85a57299-6146-4aaf-864d-9877463d7e4d" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a64141-b053-44ca-b547-6ea90ddbb64e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:42 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d Jul 11 18:45:42 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:43 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d" returned: 0 in 0.894s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:43 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d Jul 11 18:45:43 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Acquiring lock "cinder-7ea797a9-22cf-45a3-bb50-6baae4194437-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Lock "cinder-7ea797a9-22cf-45a3-bb50-6baae4194437-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Acquiring lock "cinder-quobyte-7ea797a9-22cf-45a3-bb50-6baae4194437" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Lock "cinder-quobyte-7ea797a9-22cf-45a3-bb50-6baae4194437" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e0f301-3de1-48f9-86ca-626953513ff9]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:43 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 Jul 11 18:45:43 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:43 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85a57299-6146-4aaf-864d-9877463d7e4d" returned: 0 in 0.742s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Lock "cinder-quobyte-85a57299-6146-4aaf-864d-9877463d7e4d" released by "delete_volume" :: held 1.691s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Created reservations ['965a002d-1a04-4679-8c47-33bf10ccc2eb', '354ae38d-37c9-4a2d-8309-302ef657400f', 'a1b3f8da-a4f7-46a9-96cc-cf40abbb4f9c', '43e7f596-db0d-49e0-85f4-8c5c53951243'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:44 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:44 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:44 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437" returned: 0 in 1.092s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:44 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 Jul 11 18:45:44 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:44 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.800s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Deleted volume successfully. Jul 11 18:45:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c78230bf-ade9-4cf4-82be-0a206ff36213 tempest-VolumesServicesTestJSON-97286083 None] Lock "cinder-85a57299-6146-4aaf-864d-9877463d7e4d-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:45 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437" returned: 1 in 1.034s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:45:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:45 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437 Jul 11 18:45:45 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:46 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7ea797a9-22cf-45a3-bb50-6baae4194437" returned: 0 in 0.768s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Lock "cinder-quobyte-7ea797a9-22cf-45a3-bb50-6baae4194437" released by "delete_volume" :: held 2.990s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Created reservations ['db6841ad-c08d-4c64-81b9-c7afe87e829a', 'f67c6299-3edf-49e3-910b-a9d43efa1013', 'ba75ba51-4e9e-4c31-9f13-8865cf0b157e', 'c533e4c0-d11a-4d71-bbba-4119df5cb9d4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:46 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:46 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:47 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.874s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:47 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Deleted volume successfully. Jul 11 18:45:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-60062d03-d4d3-445f-a4ef-89882e5d07ee tempest-VolumesImageMetadata-1147441597 None] Lock "cinder-7ea797a9-22cf-45a3-bb50-6baae4194437-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Flow 'volume_create_manager' (c7086cfc-0022-46e7-9a68-74f0af9683f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365adcc5-c9b5-4380-8972-75a20de255db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365adcc5-c9b5-4380-8972-75a20de255db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-780422933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11731645-ff04-4749-8adc-5fd5ef3ac868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22c364e49f40b59f31c0f78dc33748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:54Z,use_quota=True,user_id='cb83d593d8e6418ba8db56fc0cc5958c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07785022-aa58-4a89-b75f-f1d1286f36e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07785022-aa58-4a89-b75f-f1d1286f36e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d51cf38-784e-4c2c-8336-cf4418c036e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d51cf38-784e-4c2c-8336-cf4418c036e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11731645-ff04-4749-8adc-5fd5ef3ac868', 'volume_name': 'volume-11731645-ff04-4749-8adc-5fd5ef3ac868', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74ea1aa-18ed-4d9f-a6c4-9158a2c798bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74ea1aa-18ed-4d9f-a6c4-9158a2c798bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e2a6a7-d470-483a-96c5-7028ef4472cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:54 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Volume 11731645-ff04-4749-8adc-5fd5ef3ac868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11731645-ff04-4749-8adc-5fd5ef3ac868', 'volume_size': 1} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-780422933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11731645-ff04-4749-8adc-5fd5ef3ac868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22c364e49f40b59f31c0f78dc33748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:54Z,use_quota=True,user_id='cb83d593d8e6418ba8db56fc0cc5958c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Creating volume 11731645-ff04-4749-8adc-5fd5ef3ac868 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:54 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:45:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:54 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 1073741824 Jul 11 18:45:54 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:55 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 1073741824" returned: 0 in 0.989s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:55 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 Jul 11 18:45:55 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:56 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868" returned: 0 in 0.770s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e2a6a7-d470-483a-96c5-7028ef4472cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11731645-ff04-4749-8adc-5fd5ef3ac868', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8a2f8f-992e-48cd-84d5-079f21e44d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Volume volume-11731645-ff04-4749-8adc-5fd5ef3ac868 (11731645-ff04-4749-8adc-5fd5ef3ac868): created successfully Jul 11 18:45:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8a2f8f-992e-48cd-84d5-079f21e44d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Flow 'volume_create_manager' (c7086cfc-0022-46e7-9a68-74f0af9683f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-14ec256b-cd13-4410-b908-64d64e2cb489 tempest-VolumesTransfersV355Test-2049599181 None] Created volume successfully. Jul 11 18:45:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Acquiring lock "cinder-97ed1763-0678-47c2-8051-49cc878d9848-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "cinder-97ed1763-0678-47c2-8051-49cc878d9848-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Acquiring lock "cinder-quobyte-97ed1763-0678-47c2-8051-49cc878d9848" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "cinder-quobyte-97ed1763-0678-47c2-8051-49cc878d9848" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3166408f-5964-4f26-835a-0bcd5a955fc8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:57 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 Jul 11 18:45:57 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-116867da-2569-4d6d-a51c-81753a16cfa1 tempest-VolumesTransfersV355Test-1746532442 None] Transfer volume completed successfully. Jul 11 18:45:58 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848" returned: 0 in 0.880s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:58 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848 Jul 11 18:45:58 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:59 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-97ed1763-0678-47c2-8051-49cc878d9848" returned: 0 in 0.856s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "cinder-quobyte-97ed1763-0678-47c2-8051-49cc878d9848" released by "delete_volume" :: held 1.797s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Created reservations ['9689f05d-f0de-45eb-8a3b-bf4232967e0d', '3a800fb0-d7b0-4801-846e-9693c752f84f', '5a81a0af-47f1-4889-bdf0-323734aabb18', '7497c65f-8768-40ad-a71c-ec33fa94add0'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Acquiring lock "cinder-11731645-ff04-4749-8adc-5fd5ef3ac868-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:59 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:45:59 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Lock "cinder-11731645-ff04-4749-8adc-5fd5ef3ac868-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Acquiring lock "cinder-quobyte-11731645-ff04-4749-8adc-5fd5ef3ac868" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Lock "cinder-quobyte-11731645-ff04-4749-8adc-5fd5ef3ac868" acquired by "delete_volume" :: waited 0.040s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b13b3f-6721-4273-b0a4-319681ca3158]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:00 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 Jul 11 18:46:00 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:00 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.073s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:00 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Deleted volume successfully. Jul 11 18:46:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bf9380b-21b3-42a0-91af-122dc3f2ce13 tempest-AttachVolumeShelveTestJSON-425378299 None] Lock "cinder-97ed1763-0678-47c2-8051-49cc878d9848-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:01 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868" returned: 0 in 1.419s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:01 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868 Jul 11 18:46:01 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:02 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-11731645-ff04-4749-8adc-5fd5ef3ac868" returned: 0 in 0.922s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Lock "cinder-quobyte-11731645-ff04-4749-8adc-5fd5ef3ac868" released by "delete_volume" :: held 2.464s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Created reservations ['8cb87fed-1a86-4dea-beaf-307347e0e03c', 'b0c84b17-1d48-487c-a981-322a112e29a4', 'cc7147c9-56da-4b75-b2ac-0bbd654c3dbf', '61d11766-9a15-48c4-88f2-17281fb35564'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Flow 'volume_create_manager' (a540f6e6-ff55-4013-a5df-0bcbbe46bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88958e38-6c13-4d8a-b242-cc3dd821a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88958e38-6c13-4d8a-b242-cc3dd821a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1411756773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bbebe7-06eb-4bcb-9d73-27ddcf314146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be334cf1438d4652a82ef9841bda7d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:03Z,use_quota=True,user_id='cc831eeb2992472b8274cb17d2bed8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4d9c2a-88c2-4466-904e-527138b56dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4d9c2a-88c2-4466-904e-527138b56dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8f5dc3-96cd-4c03-abb5-d81c88efb6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8f5dc3-96cd-4c03-abb5-d81c88efb6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bbebe7-06eb-4bcb-9d73-27ddcf314146', 'volume_name': 'volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161f9c60-5900-48f5-9cab-e2a57548d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161f9c60-5900-48f5-9cab-e2a57548d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ded147e-f111-4d0a-8616-dcec4889d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Volume 94bbebe7-06eb-4bcb-9d73-27ddcf314146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146', 'volume_size': 1} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1411756773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bbebe7-06eb-4bcb-9d73-27ddcf314146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be334cf1438d4652a82ef9841bda7d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:03Z,use_quota=True,user_id='cc831eeb2992472b8274cb17d2bed8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Creating volume 94bbebe7-06eb-4bcb-9d73-27ddcf314146 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:02 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:02 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 1073741824 Jul 11 18:46:02 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:02 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:46:02 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:03 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.868s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Deleted volume successfully. Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed2a1042-a55b-49b4-b4a2-46a39076e90b tempest-VolumesTransfersV355Test-175626039 None] Lock "cinder-11731645-ff04-4749-8adc-5fd5ef3ac868-delete_volume" released by "delete_volume" :: held 3.879s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Flow 'volume_create_manager' (dcf3c60d-555b-46ed-bf9c-2bafa4fc7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799975b7-4740-4f95-a24d-bbde7a2f653a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:03 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 1073741824" returned: 0 in 1.163s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799975b7-4740-4f95-a24d-bbde7a2f653a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1538446684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d761fa70-9cc5-4be1-9241-2abe5068b860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22c364e49f40b59f31c0f78dc33748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:04Z,use_quota=True,user_id='cb83d593d8e6418ba8db56fc0cc5958c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565dfeda-dcb1-4003-ab9f-4baf6b443fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565dfeda-dcb1-4003-ab9f-4baf6b443fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df22a4c9-b049-464d-8215-609f7557e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df22a4c9-b049-464d-8215-609f7557e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd761fa70-9cc5-4be1-9241-2abe5068b860', 'volume_name': 'volume-d761fa70-9cc5-4be1-9241-2abe5068b860', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71be4d88-8113-4c19-bebb-521ddae7afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71be4d88-8113-4c19-bebb-521ddae7afed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7e7b97-a481-4194-b35e-711e261b5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Volume d761fa70-9cc5-4be1-9241-2abe5068b860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d761fa70-9cc5-4be1-9241-2abe5068b860', 'volume_size': 1} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:04 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 Jul 11 18:46:04 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:04 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146" returned: 0 in 0.807s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.835s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1538446684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d761fa70-9cc5-4be1-9241-2abe5068b860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22c364e49f40b59f31c0f78dc33748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:04Z,use_quota=True,user_id='cb83d593d8e6418ba8db56fc0cc5958c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Creating volume d761fa70-9cc5-4be1-9241-2abe5068b860 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ded147e-f111-4d0a-8616-dcec4889d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:04 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 1073741824 Jul 11 18:46:04 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13cff32-2b82-4f29-93d6-47eae94a6ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Volume volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 (94bbebe7-06eb-4bcb-9d73-27ddcf314146): created successfully Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13cff32-2b82-4f29-93d6-47eae94a6ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Flow 'volume_create_manager' (a540f6e6-ff55-4013-a5df-0bcbbe46bda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-31ba3c6e-6ada-483a-9e84-6d3e230c237c tempest-SnapshotMetadataTestJSON-1738796854 None] Created volume successfully. Jul 11 18:46:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:06 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 1073741824" returned: 0 in 1.499s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:06 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 Jul 11 18:46:06 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:07 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860" returned: 0 in 0.729s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.937s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Creating offline snapshot 5b0a2264-9baa-4a29-b43e-9039c900bcf9 of volume 94bbebe7-06eb-4bcb-9d73-27ddcf314146 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7e7b97-a481-4194-b35e-711e261b5289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d761fa70-9cc5-4be1-9241-2abe5068b860', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f6e717-4dc1-449d-bdb0-d0271811e99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26efa00-e8d2-415b-9039-1ac3c7a7921a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Volume volume-d761fa70-9cc5-4be1-9241-2abe5068b860 (d761fa70-9cc5-4be1-9241-2abe5068b860): created successfully Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f6e717-4dc1-449d-bdb0-d0271811e99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Flow 'volume_create_manager' (dcf3c60d-555b-46ed-bf9c-2bafa4fc7c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ade2e05c-b40a-4662-b8be-fba899706f70 tempest-VolumesTransfersV355Test-2049599181 None] Created volume successfully. Jul 11 18:46:07 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 Jul 11 18:46:07 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:08 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146" returned: 0 in 0.948s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:08 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 1G Jul 11 18:46:08 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Acquiring lock "cinder-d761fa70-9cc5-4be1-9241-2abe5068b860-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Lock "cinder-d761fa70-9cc5-4be1-9241-2abe5068b860-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Acquiring lock "cinder-quobyte-d761fa70-9cc5-4be1-9241-2abe5068b860" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Lock "cinder-quobyte-d761fa70-9cc5-4be1-9241-2abe5068b860" acquired by "delete_volume" :: waited 0.050s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c418884-f156-424a-ae8b-3dad5fb26f5e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:08 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 Jul 11 18:46:08 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:09 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 1G" returned: 0 in 1.209s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:09 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 Jul 11 18:46:09 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:09 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860" returned: 0 in 1.260s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:10 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860 Jul 11 18:46:10 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:10 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9" returned: 0 in 1.110s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:10 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 is being set with open permissions: ugo+rw Jul 11 18:46:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:10 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 Jul 11 18:46:10 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:11 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d761fa70-9cc5-4be1-9241-2abe5068b860" returned: 0 in 1.184s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Lock "cinder-quobyte-d761fa70-9cc5-4be1-9241-2abe5068b860" released by "delete_volume" :: held 2.543s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Created reservations ['81bf3011-1307-4b28-a822-03cf489b303c', '5cc95db9-325d-4bd9-902c-01a14c193f59', 'c9a7509e-1e8a-4564-b3a1-02ee1903bf66', 'b2d0c8a3-e593-4e4b-8a43-ccf3b11d13b9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:11 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9" returned: 0 in 0.992s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:11 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:46:11 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:11 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.info Jul 11 18:46:11 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:12 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.info" returned: 0 in 1.137s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:12 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.info is being set with open permissions: ugo+rw Jul 11 18:46:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:12 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.info Jul 11 18:46:12 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:12 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.537s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:12 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Deleted volume successfully. Jul 11 18:46:13 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=68,cinder:INSERT=27,cinder:UPDATE=94,cinder:DELETE=11 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:46:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3cf8e074-4b16-4c7a-a2d0-e288138dcbd8 tempest-VolumesTransfersV355Test-175626039 None] Lock "cinder-d761fa70-9cc5-4be1-9241-2abe5068b860-delete_volume" released by "delete_volume" :: held 4.568s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:13 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.info" returned: 0 in 1.141s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.765s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:13 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=81,cinder:INSERT=29,cinder:UPDATE=99,cinder:DELETE=4 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:46:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3f925ea8-3a15-4e7c-9002-116f90515b4f tempest-SnapshotMetadataTestJSON-1738796854 None] Create snapshot completed successfully Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:15 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:46:15 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "cinder-5b0a2264-9baa-4a29-b43e-9039c900bcf9-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-5b0a2264-9baa-4a29-b43e-9039c900bcf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "cinder-quobyte-94bbebe7-06eb-4bcb-9d73-27ddcf314146" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-quobyte-94bbebe7-06eb-4bcb-9d73-27ddcf314146" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "cinder-quobyte-5b0a2264-9baa-4a29-b43e-9039c900bcf9" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-quobyte-5b0a2264-9baa-4a29-b43e-9039c900bcf9" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Deleting offline snapshot 5b0a2264-9baa-4a29-b43e-9039c900bcf9 of volume 94bbebe7-06eb-4bcb-9d73-27ddcf314146 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] snapshot_file for this snap is: volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4ba71b-200c-4aca-a1ad-c18b7fa86083]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:16 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:46:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:46:16 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 Jul 11 18:46:16 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:17 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9" returned: 0 in 1.235s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:46:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9213f5-b285-4bd4-b068-0da2ce8fb768]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:17 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 Jul 11 18:46:17 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:18 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146" returned: 0 in 1.165s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:18 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 Jul 11 18:46:18 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:19 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9" returned: 0 in 1.029s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:19 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9 Jul 11 18:46:19 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:20 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146.5b0a2264-9baa-4a29-b43e-9039c900bcf9" returned: 0 in 0.951s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-quobyte-5b0a2264-9baa-4a29-b43e-9039c900bcf9" released by "_delete_snapshot" :: held 4.589s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-quobyte-94bbebe7-06eb-4bcb-9d73-27ddcf314146" released by "delete_snapshot" :: held 4.638s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Created reservations ['feda67d0-f323-47ae-9235-35ec967849a0', 'cda959ba-11c7-4e85-9433-2c3733ba8e22', 'a8eaf049-76d7-4917-aafa-c6e59281d2c0', 'f28f4497-8fdb-4390-b219-be45f657f792'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Delete snapshot completed successfully. Jul 11 18:46:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6b4939e2-b9a4-431f-a2b2-17f7b896f55c tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-5b0a2264-9baa-4a29-b43e-9039c900bcf9-delete_snapshot" released by "delete_snapshot" :: held 4.887s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:20 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Flow 'volume_create_manager' (22e104ed-9653-4cad-8009-9edd59609ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57905ced-343e-4a66-85d5-6147b3219bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57905ced-343e-4a66-85d5-6147b3219bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1217441476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7694d9-1cfa-4ce9-84ee-3fb4763963c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd19266254c742f5a098bd79d8afb800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:21Z,use_quota=True,user_id='821e0221c9f04cd68413ed6a4aaf3b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9c74e8-7944-4299-a64a-e65c7dafe420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9c74e8-7944-4299-a64a-e65c7dafe420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495e324a-29c8-438b-b112-bd8e09d41d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495e324a-29c8-438b-b112-bd8e09d41d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7694d9-1cfa-4ce9-84ee-3fb4763963c5', 'volume_name': 'volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5', 'volume_size': 2}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fd95e1-b576-4e94-be18-bd40776d69e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fd95e1-b576-4e94-be18-bd40776d69e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4e5d17-5a14-4ec5-b46f-074ca85e5c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Volume af7694d9-1cfa-4ce9-84ee-3fb4763963c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5', 'volume_size': 2} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1217441476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7694d9-1cfa-4ce9-84ee-3fb4763963c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd19266254c742f5a098bd79d8afb800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:21Z,use_quota=True,user_id='821e0221c9f04cd68413ed6a4aaf3b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Creating volume af7694d9-1cfa-4ce9-84ee-3fb4763963c5 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:21 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 2147483648 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:21 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 2147483648 Jul 11 18:46:21 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "cinder-94bbebe7-06eb-4bcb-9d73-27ddcf314146-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-94bbebe7-06eb-4bcb-9d73-27ddcf314146-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "cinder-quobyte-94bbebe7-06eb-4bcb-9d73-27ddcf314146" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-quobyte-94bbebe7-06eb-4bcb-9d73-27ddcf314146" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b0a8e5-682d-49e5-a0a1-348cdf8169a4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:21 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 Jul 11 18:46:21 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:22 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 2147483648" returned: 0 in 1.028s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:22 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 Jul 11 18:46:22 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:22 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146" returned: 0 in 0.868s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:22 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146 Jul 11 18:46:22 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:22 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4e5d17-5a14-4ec5-b46f-074ca85e5c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5', 'volume_size': 2}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667f250d-8ae6-43b3-b25d-92ed5f4683e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:22 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Volume volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 (af7694d9-1cfa-4ce9-84ee-3fb4763963c5): created successfully Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667f250d-8ae6-43b3-b25d-92ed5f4683e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Flow 'volume_create_manager' (22e104ed-9653-4cad-8009-9edd59609ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d4783cba-cfcb-4486-ad1f-d1051eaf316d tempest-VolumesCloneNegativeTest-1665271099 None] Created volume successfully. Jul 11 18:46:23 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-94bbebe7-06eb-4bcb-9d73-27ddcf314146" returned: 0 in 0.720s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-quobyte-94bbebe7-06eb-4bcb-9d73-27ddcf314146" released by "delete_volume" :: held 1.656s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Acquiring lock "cinder-af7694d9-1cfa-4ce9-84ee-3fb4763963c5-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Created reservations ['6f29acb7-d9f7-4691-8419-5e432776995a', '4b38e023-c2ea-4b2a-866b-1b61dceb4e50', 'dd8ea340-d159-47f5-881d-6d6f2f15d544', '6641ee04-b710-4cc2-ad76-356d0a392c09'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Lock "cinder-af7694d9-1cfa-4ce9-84ee-3fb4763963c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Acquiring lock "cinder-quobyte-af7694d9-1cfa-4ce9-84ee-3fb4763963c5" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Lock "cinder-quobyte-af7694d9-1cfa-4ce9-84ee-3fb4763963c5" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e37777e-38c3-44af-b36e-b7697df09cdc]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:23 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:46:23 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:23 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 Jul 11 18:46:23 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:24 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:24 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Deleted volume successfully. Jul 11 18:46:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11f62f08-a4f4-47ea-9e18-fc651835275a tempest-SnapshotMetadataTestJSON-1738796854 None] Lock "cinder-94bbebe7-06eb-4bcb-9d73-27ddcf314146-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:24 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5" returned: 0 in 0.839s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:24 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5 Jul 11 18:46:24 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:24 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af7694d9-1cfa-4ce9-84ee-3fb4763963c5" returned: 0 in 0.672s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Lock "cinder-quobyte-af7694d9-1cfa-4ce9-84ee-3fb4763963c5" released by "delete_volume" :: held 1.556s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:24 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Created reservations ['6cb390ed-6c5d-4a3a-80de-3ce0b5f80617', '394e02f8-c3d7-4793-ac46-3a7fb40e3234', '9392505b-c9f2-4cf9-bb84-0ea0130ff44f', '92016a53-7916-4d64-9a0e-f130d720b3e9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:25 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:46:25 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:25 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.689s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Deleted volume successfully. Jul 11 18:46:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ab9e9fd5-4892-405b-ba48-5670d2fce4ca tempest-VolumesCloneNegativeTest-1665271099 None] Lock "cinder-af7694d9-1cfa-4ce9-84ee-3fb4763963c5-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Flow 'volume_create_manager' (ac92ef77-b74d-4c5e-9c27-07c4e977a461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7d65e9-5da9-4ac0-ae92-6ade8ff273bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7d65e9-5da9-4ac0-ae92-6ade8ff273bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2045893443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07877359-1c28-41d0-bace-52f8f8c9d81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8f56fef984994873ffebb185bd100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:33Z,use_quota=True,user_id='2b62303bf5ad4ec486ad0699f61ae789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453acd29-8950-41ba-8336-2a07b17c1688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453acd29-8950-41ba-8336-2a07b17c1688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc06d0d-844f-4759-850d-a9eb929b9d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc06d0d-844f-4759-850d-a9eb929b9d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07877359-1c28-41d0-bace-52f8f8c9d81b', 'volume_name': 'volume-07877359-1c28-41d0-bace-52f8f8c9d81b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e95adfa-0d3d-4fcf-ba96-30232f427d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e95adfa-0d3d-4fcf-ba96-30232f427d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb46621-4ea9-4859-8b30-87735ea0baed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Volume 07877359-1c28-41d0-bace-52f8f8c9d81b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07877359-1c28-41d0-bace-52f8f8c9d81b', 'volume_size': 1} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2045893443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07877359-1c28-41d0-bace-52f8f8c9d81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8f56fef984994873ffebb185bd100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:33Z,use_quota=True,user_id='2b62303bf5ad4ec486ad0699f61ae789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Creating volume 07877359-1c28-41d0-bace-52f8f8c9d81b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:46:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:33 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b 1073741824 Jul 11 18:46:33 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:34 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b 1073741824" returned: 0 in 1.084s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:34 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b Jul 11 18:46:34 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:35 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b" returned: 0 in 0.863s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb46621-4ea9-4859-8b30-87735ea0baed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07877359-1c28-41d0-bace-52f8f8c9d81b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850aa4d3-6975-46f4-bd4a-da23cf0c6b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Volume volume-07877359-1c28-41d0-bace-52f8f8c9d81b (07877359-1c28-41d0-bace-52f8f8c9d81b): created successfully Jul 11 18:46:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850aa4d3-6975-46f4-bd4a-da23cf0c6b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Flow 'volume_create_manager' (ac92ef77-b74d-4c5e-9c27-07c4e977a461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2c3187bb-c58f-4a35-b8af-e30545838c81 tempest-AttachVolumeTestJSON-1769326654 None] Created volume successfully. Jul 11 18:46:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2450520a-36e0-43e0-a6c0-41590b4871b5 req-e9627c25-880b-486a-89a6-ffa698a4fbb9 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2450520a-36e0-43e0-a6c0-41590b4871b5 req-e9627c25-880b-486a-89a6-ffa698a4fbb9 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ae56ca-2423-46c3-b2be-04a37ae1e623]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-2450520a-36e0-43e0-a6c0-41590b4871b5 req-e9627c25-880b-486a-89a6-ffa698a4fbb9 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:40 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b Jul 11 18:46:40 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:40 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-2450520a-36e0-43e0-a6c0-41590b4871b5 req-e9627c25-880b-486a-89a6-ffa698a4fbb9 tempest-AttachVolumeTestJSON-1769326654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b" returned: 0 in 1.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2450520a-36e0-43e0-a6c0-41590b4871b5 req-e9627c25-880b-486a-89a6-ffa698a4fbb9 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.066s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-2450520a-36e0-43e0-a6c0-41590b4871b5 req-e9627c25-880b-486a-89a6-ffa698a4fbb9 tempest-AttachVolumeTestJSON-1769326654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-07877359-1c28-41d0-bace-52f8f8c9d81b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ae15ff0-d4be-49d6-b889-073ce76f7bcf', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:46:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-2450520a-36e0-43e0-a6c0-41590b4871b5 req-e9627c25-880b-486a-89a6-ffa698a4fbb9 tempest-AttachVolumeTestJSON-1769326654 None] attachment_update completed successfully. Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (705bdfbe-8844-4f75-8c59-118be35e49a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76c4451-3d97-451c-ad51-dc3610ed70e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76c4451-3d97-451c-ad51-dc3610ed70e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2015133824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc99b16-c0b2-48fc-af5d-657ab373a9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09751447432471e8a9412f98023a8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:42Z,use_quota=True,user_id='66d349e5dbd24cbaada0d021f22545fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bb2981-0610-4c61-a00f-57e39d7c2ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bb2981-0610-4c61-a00f-57e39d7c2ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8635490c-1817-46ac-8fc2-587168c3f1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8635490c-1817-46ac-8fc2-587168c3f1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc99b16-c0b2-48fc-af5d-657ab373a9cc', 'volume_name': 'volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acef496e-051a-4b6a-b2c5-35cae8ba3802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acef496e-051a-4b6a-b2c5-35cae8ba3802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cb0533-ee19-432d-8611-4accba96698d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume cbc99b16-c0b2-48fc-af5d-657ab373a9cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc', 'volume_size': 1} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2015133824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc99b16-c0b2-48fc-af5d-657ab373a9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09751447432471e8a9412f98023a8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:42Z,use_quota=True,user_id='66d349e5dbd24cbaada0d021f22545fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Creating volume cbc99b16-c0b2-48fc-af5d-657ab373a9cc {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:41 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:46:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:41 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc 1073741824 Jul 11 18:46:41 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:42 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc 1073741824" returned: 0 in 1.057s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:42 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc Jul 11 18:46:42 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:43 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" returned: 0 in 0.960s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cb0533-ee19-432d-8611-4accba96698d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7a1787-52fc-4fbe-9dcc-3dd617b8e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc (cbc99b16-c0b2-48fc-af5d-657ab373a9cc): created successfully Jul 11 18:46:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7a1787-52fc-4fbe-9dcc-3dd617b8e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (705bdfbe-8844-4f75-8c59-118be35e49a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4e32b37f-db22-4ac4-b1fe-631d529bce55 tempest-VolumesSnapshotTestJSON-2131569175 None] Created volume successfully. Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Flow 'volume_create_manager' (901d6d3b-49e8-44e9-8857-b680eaf74e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e86785-c829-4a3d-8e9f-70c46050dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e86785-c829-4a3d-8e9f-70c46050dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-871448867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e19580-2028-450d-acd0-b9dc0699925c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00548906a35c4a6e95099bcd80d9cdee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:45Z,use_quota=True,user_id='1397b2bad21d4726a36a71a6a01059a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeec38bb-6462-4a45-bb87-d95ddf5d4282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeec38bb-6462-4a45-bb87-d95ddf5d4282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d46c17-b615-41bc-93a6-429dc07f2e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d46c17-b615-41bc-93a6-429dc07f2e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e19580-2028-450d-acd0-b9dc0699925c', 'volume_name': 'volume-69e19580-2028-450d-acd0-b9dc0699925c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80fe259-090a-47d1-a2e6-4fdd4ce8c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80fe259-090a-47d1-a2e6-4fdd4ce8c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f9bb46-24f6-40ef-8067-35c2b99f3cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Volume 69e19580-2028-450d-acd0-b9dc0699925c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e19580-2028-450d-acd0-b9dc0699925c', 'volume_size': 1} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-871448867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e19580-2028-450d-acd0-b9dc0699925c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00548906a35c4a6e95099bcd80d9cdee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:45Z,use_quota=True,user_id='1397b2bad21d4726a36a71a6a01059a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Creating volume 69e19580-2028-450d-acd0-b9dc0699925c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:45 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:45 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c 1073741824 Jul 11 18:46:45 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:46 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c 1073741824" returned: 0 in 0.921s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:46 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c Jul 11 18:46:46 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:47 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c" returned: 0 in 0.880s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.804s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Creating offline snapshot cf75913c-3c84-4999-b43d-e5f6f29cee42 of volume cbc99b16-c0b2-48fc-af5d-657ab373a9cc {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f9bb46-24f6-40ef-8067-35c2b99f3cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e19580-2028-450d-acd0-b9dc0699925c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34b5e4a-db79-4a0b-9d42-9bdb3094af63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd3c286-1417-4d19-81da-2c5e0308d8bf]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Volume volume-69e19580-2028-450d-acd0-b9dc0699925c (69e19580-2028-450d-acd0-b9dc0699925c): created successfully Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34b5e4a-db79-4a0b-9d42-9bdb3094af63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Flow 'volume_create_manager' (901d6d3b-49e8-44e9-8857-b680eaf74e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f50b4de2-f134-4b4b-beb2-5331b5191d58 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Created volume successfully. Jul 11 18:46:47 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc Jul 11 18:46:47 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:47 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" returned: 0 in 0.865s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:47 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 1G Jul 11 18:46:47 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:48 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 1G" returned: 0 in 0.934s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:48 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 Jul 11 18:46:48 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:49 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42" returned: 0 in 0.821s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:49 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 is being set with open permissions: ugo+rw Jul 11 18:46:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:49 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 Jul 11 18:46:49 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:50 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:50 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.info Jul 11 18:46:50 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:51 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.info" returned: 0 in 0.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:51 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.info is being set with open permissions: ugo+rw Jul 11 18:46:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:51 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.info Jul 11 18:46:51 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:51 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.info" returned: 0 in 0.721s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.805s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.371s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Creating offline snapshot 342742cf-535f-4226-9eab-426cf1f63db4 of volume 69e19580-2028-450d-acd0-b9dc0699925c {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:46:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dd3868-842d-420d-8737-3cccd1fb37f7]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-00c9efb5-bac3-42f2-a19e-4667607c6ec6 tempest-VolumesSnapshotTestJSON-2131569175 None] Create snapshot completed successfully Jul 11 18:46:52 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c Jul 11 18:46:52 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-cf75913c-3c84-4999-b43d-e5f6f29cee42-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-cf75913c-3c84-4999-b43d-e5f6f29cee42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:52 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c" returned: 0 in 0.978s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-cf75913c-3c84-4999-b43d-e5f6f29cee42" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cf75913c-3c84-4999-b43d-e5f6f29cee42" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:52 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 1G Jul 11 18:46:52 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Deleting offline snapshot cf75913c-3c84-4999-b43d-e5f6f29cee42 of volume cbc99b16-c0b2-48fc-af5d-657ab373a9cc {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] snapshot_file for this snap is: volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc05b0b-5bb0-490b-a48d-153f7c2a72f7]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:53 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 Jul 11 18:46:53 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:53 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 1G" returned: 0 in 0.914s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e19580-2028-450d-acd0-b9dc0699925c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:53 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e19580-2028-450d-acd0-b9dc0699925c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 Jul 11 18:46:53 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:53 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42" returned: 0 in 0.923s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:46:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b25bfe-6486-4d6c-87cb-7c225c59fad7]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:54 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc Jul 11 18:46:54 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:54 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e19580-2028-450d-acd0-b9dc0699925c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4" returned: 0 in 0.748s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:54 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 is being set with open permissions: ugo+rw Jul 11 18:46:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:54 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 Jul 11 18:46:54 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:54 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" returned: 0 in 1.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:54 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 Jul 11 18:46:54 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:55 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4" returned: 0 in 1.027s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:55 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.info Jul 11 18:46:55 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:55 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42" returned: 0 in 0.932s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:55 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42 Jul 11 18:46:55 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:56 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.info" returned: 0 in 0.778s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:56 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.info is being set with open permissions: ugo+rw Jul 11 18:46:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:56 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.info Jul 11 18:46:56 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:56 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc.cf75913c-3c84-4999-b43d-e5f6f29cee42" returned: 0 in 0.754s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cf75913c-3c84-4999-b43d-e5f6f29cee42" released by "_delete_snapshot" :: held 3.754s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" released by "delete_snapshot" :: held 3.781s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:56 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Created reservations ['b5376cea-7415-47e1-b9f6-c7e2b7d42bcb', 'cfda666c-1991-4ca7-b855-862670f9ad95', '899ee0a9-63b2-41bb-971c-6cb0b0ea9afa', '793be9ae-e0cb-4fc3-9406-3d03488640a9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Delete snapshot completed successfully. Jul 11 18:46:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-992cd408-969e-4124-8f03-7cf7b4e92fc9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-cf75913c-3c84-4999-b43d-e5f6f29cee42-delete_snapshot" released by "delete_snapshot" :: held 3.981s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:57 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.info" returned: 0 in 0.700s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.287s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-354771f0-7a4f-4cb2-8b1d-a61a21dcd6be tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Create snapshot completed successfully Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (b93daff0-ae34-4793-9cec-ccdaff2027c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6309e3fd-23f1-448b-9c77-a6db09762c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6309e3fd-23f1-448b-9c77-a6db09762c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2120776884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3bdc48-6b02-41b6-addb-c5ddabfd568e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09751447432471e8a9412f98023a8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:58Z,use_quota=True,user_id='66d349e5dbd24cbaada0d021f22545fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2944a1-df43-4d92-bc3c-1c07bfaf9379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2944a1-df43-4d92-bc3c-1c07bfaf9379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd9278b-6383-475b-abe0-abdd1554b702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd9278b-6383-475b-abe0-abdd1554b702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af3bdc48-6b02-41b6-addb-c5ddabfd568e', 'volume_name': 'volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f9dad4-d28f-4986-a8c0-f6ae4b977019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f9dad4-d28f-4986-a8c0-f6ae4b977019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dbe1b3-1dfc-4e85-9b6b-02b86fb0ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Volume af3bdc48-6b02-41b6-addb-c5ddabfd568e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e', 'volume_size': 1} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2120776884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3bdc48-6b02-41b6-addb-c5ddabfd568e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09751447432471e8a9412f98023a8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:58Z,use_quota=True,user_id='66d349e5dbd24cbaada0d021f22545fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Creating volume af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:57 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:46:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:57 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e 1073741824 Jul 11 18:46:57 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "cinder-342742cf-535f-4226-9eab-426cf1f63db4-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-342742cf-535f-4226-9eab-426cf1f63db4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "cinder-quobyte-69e19580-2028-450d-acd0-b9dc0699925c" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-quobyte-69e19580-2028-450d-acd0-b9dc0699925c" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "cinder-quobyte-342742cf-535f-4226-9eab-426cf1f63db4" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-quobyte-342742cf-535f-4226-9eab-426cf1f63db4" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Deleting offline snapshot 342742cf-535f-4226-9eab-426cf1f63db4 of volume 69e19580-2028-450d-acd0-b9dc0699925c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] snapshot_file for this snap is: volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12952ab-822c-4c29-8f5d-4b52f8ba8d8f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:58 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 Jul 11 18:46:58 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:59 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e 1073741824" returned: 0 in 1.337s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:59 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e Jul 11 18:46:59 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:00 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4" returned: 0 in 1.483s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e19580-2028-450d-acd0-b9dc0699925c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9560dbcf-89cc-4c7a-882c-43a750e816fe]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:00 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e" returned: 0 in 0.973s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] <== create_volume: return (2386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dbe1b3-1dfc-4e85-9b6b-02b86fb0ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10178734-3756-4e5d-afcc-a0c05c99adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Volume volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e (af3bdc48-6b02-41b6-addb-c5ddabfd568e): created successfully Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10178734-3756-4e5d-afcc-a0c05c99adf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (b93daff0-ae34-4793-9cec-ccdaff2027c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ec6f7c7e-4239-4000-86e3-3f89548c1daf tempest-VolumesSnapshotTestJSON-2131569175 None] Created volume successfully. Jul 11 18:47:00 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c Jul 11 18:47:00 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:01 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c" returned: 0 in 0.838s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:01 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 Jul 11 18:47:01 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Creating offline snapshot 90eda20f-529b-4ef3-96dc-a8053141bc07 of volume af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:47:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e432e-54f7-407c-bebc-7e3c72c05a01]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:01 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e Jul 11 18:47:01 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:02 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4" returned: 0 in 1.336s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:02 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4 Jul 11 18:47:02 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:02 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e" returned: 0 in 1.443s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:02 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 1G Jul 11 18:47:02 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:03 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c.342742cf-535f-4226-9eab-426cf1f63db4" returned: 0 in 1.176s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-quobyte-342742cf-535f-4226-9eab-426cf1f63db4" released by "_delete_snapshot" :: held 5.074s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-quobyte-69e19580-2028-450d-acd0-b9dc0699925c" released by "delete_snapshot" :: held 5.129s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:03 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Created reservations ['ceef4d78-15b8-42e9-b81c-ae302f699394', 'a2c85a88-58a2-4b61-94ce-8e32ab4f1ccc', '8265bb84-ad76-4804-807a-e203a71060ec', '9bfd1cf7-ff74-453c-9c91-48ccc001e48e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Delete snapshot completed successfully. Jul 11 18:47:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5671feb-69f3-4a2f-a727-0764861992ce tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-342742cf-535f-4226-9eab-426cf1f63db4-delete_snapshot" released by "delete_snapshot" :: held 5.414s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:04 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 1G" returned: 0 in 1.234s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:04 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 Jul 11 18:47:04 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "cinder-69e19580-2028-450d-acd0-b9dc0699925c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-69e19580-2028-450d-acd0-b9dc0699925c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "cinder-quobyte-69e19580-2028-450d-acd0-b9dc0699925c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-quobyte-69e19580-2028-450d-acd0-b9dc0699925c" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff450e99-5c94-416b-8423-bfe76a3ba0ba]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:05 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07" returned: 0 in 1.459s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:05 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 is being set with open permissions: ugo+rw Jul 11 18:47:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:05 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 Jul 11 18:47:05 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:05 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c Jul 11 18:47:05 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:06 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07" returned: 0 in 1.092s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:06 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.info Jul 11 18:47:06 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:06 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c" returned: 0 in 1.263s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:06 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c Jul 11 18:47:06 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:07 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.info" returned: 0 in 0.683s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:07 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.info is being set with open permissions: ugo+rw Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:07 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.info Jul 11 18:47:07 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:07 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-69e19580-2028-450d-acd0-b9dc0699925c" returned: 0 in 0.729s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-quobyte-69e19580-2028-450d-acd0-b9dc0699925c" released by "delete_volume" :: held 2.090s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Created reservations ['fb14260a-0ffa-4582-a8bc-bce9ed0535d9', 'f8732950-75df-48a1-ad55-0fb90893a9e9', 'db326ea7-e270-4c6f-ba9f-578bc977e5f6', '52381a39-a89c-42c9-9378-a95bd364f913'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:07 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:47:07 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:08 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.info" returned: 0 in 0.813s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.915s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-464034d4-fb38-4342-8233-e8f956a433c7 tempest-VolumesSnapshotTestJSON-2131569175 None] Create snapshot completed successfully Jul 11 18:47:08 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.826s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:08 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Deleted volume successfully. Jul 11 18:47:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9c8e2f7f-224c-4928-959e-9678726b22b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-245567476 None] Lock "cinder-69e19580-2028-450d-acd0-b9dc0699925c-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (8f931d13-9b73-43df-a8c4-1a867936f9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04317e88-c10e-48f4-a317-7d0f989bfc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04317e88-c10e-48f4-a317-7d0f989bfc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1191348926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cadd08-640a-4928-9270-e1ee04f5fcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09751447432471e8a9412f98023a8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=90eda20f-529b-4ef3-96dc-a8053141bc07,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:10Z,use_quota=True,user_id='66d349e5dbd24cbaada0d021f22545fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a28d80-0893-4eae-87fb-295413ea9c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a28d80-0893-4eae-87fb-295413ea9c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6371cdc-7824-4bec-94fb-bd64e001b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6371cdc-7824-4bec-94fb-bd64e001b109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9cadd08-640a-4928-9270-e1ee04f5fcc5', 'volume_name': 'volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5', 'volume_size': 2, 'snapshot_id': '90eda20f-529b-4ef3-96dc-a8053141bc07'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fce38a5-6097-4d27-9982-b71dfd42b50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fce38a5-6097-4d27-9982-b71dfd42b50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f50c56a-a013-416f-9718-702f5e0a12a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume e9cadd08-640a-4928-9270-e1ee04f5fcc5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5', 'volume_size': 2, 'snapshot_id': '90eda20f-529b-4ef3-96dc-a8053141bc07'} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-90eda20f-529b-4ef3-96dc-a8053141bc07-e9cadd08-640a-4928-9270-e1ee04f5fcc5" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-90eda20f-529b-4ef3-96dc-a8053141bc07-e9cadd08-640a-4928-9270-e1ee04f5fcc5" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Creating volume e9cadd08-640a-4928-9270-e1ee04f5fcc5 from snapshot 90eda20f-529b-4ef3-96dc-a8053141bc07 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-e9cadd08-640a-4928-9270-e1ee04f5fcc5" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-e9cadd08-640a-4928-9270-e1ee04f5fcc5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] snapshot: 90eda20f-529b-4ef3-96dc-a8053141bc07, volume: e9cadd08-640a-4928-9270-e1ee04f5fcc5, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dece2d3d-74af-4c01-87fb-ef742f49e324]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:10 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 Jul 11 18:47:10 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:11 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07" returned: 0 in 1.107s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:47:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:47:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:47:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bcca8a-c046-4773-a799-8b04350edbde]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:11 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e Jul 11 18:47:11 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:12 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e" returned: 0 in 1.021s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:12 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:47:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:12 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 Jul 11 18:47:12 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:47:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:15 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:47:15 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:16 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=68,cinder:INSERT=12,cinder:UPDATE=65,cinder:DELETE=8 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:47:16 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=62,cinder:DELETE=4,cinder:SELECT=64,cinder:INSERT=20 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:47:17 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.945s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:17 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:17 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:47:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:47:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:47:20 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5" returned: 0 in 8.511s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d343aa3c-6c61-4792-b5da-596c5ea8a4ec]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:21 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e Jul 11 18:47:21 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Flow 'volume_create_manager' (982ce11d-18c9-4b44-8821-ad30be3648e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1262cc34-8014-49ef-aee6-fa885bda6359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1262cc34-8014-49ef-aee6-fa885bda6359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-645088271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc0deb75847c4278a09cb44b8747b0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:21Z,use_quota=True,user_id='31229491918443b68d838ff5c8279db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47bced5-ff73-4f7f-8834-5dd290755925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47bced5-ff73-4f7f-8834-5dd290755925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ba4933-4b1e-46a5-9788-4a8b5e69fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ba4933-4b1e-46a5-9788-4a8b5e69fef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09', 'volume_name': 'volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca3b74b-dd95-47b0-ab98-f86e63960b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca3b74b-dd95-47b0-ab98-f86e63960b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61f1e15-8d2b-4eb6-b864-dbc3c9fa980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Volume a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09', 'volume_size': 1} Jul 11 18:47:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:22 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e" returned: 0 in 1.439s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:22 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:47:22 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Converted 1024.00 MB image at 120.30 MB/s Jul 11 18:47:22 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 is being set with open permissions: ugo+rw Jul 11 18:47:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:22 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 Jul 11 18:47:22 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:23 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5" returned: 0 in 0.697s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-e9cadd08-640a-4928-9270-e1ee04f5fcc5" released by "_copy_volume_from_snapshot" :: held 12.957s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-90eda20f-529b-4ef3-96dc-a8053141bc07-e9cadd08-640a-4928-9270-e1ee04f5fcc5" released by "_create_volume_from_snapshot" :: held 13.005s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.038s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-645088271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc0deb75847c4278a09cb44b8747b0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:21Z,use_quota=True,user_id='31229491918443b68d838ff5c8279db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Creating volume a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:47:23 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:23 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 1073741824 Jul 11 18:47:23 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f50c56a-a013-416f-9718-702f5e0a12a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5', 'volume_size': 2, 'snapshot_id': '90eda20f-529b-4ef3-96dc-a8053141bc07'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1722e510-e52f-4b89-9a98-570fd43f71dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 (e9cadd08-640a-4928-9270-e1ee04f5fcc5): created successfully Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1722e510-e52f-4b89-9a98-570fd43f71dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (8f931d13-9b73-43df-a8c4-1a867936f9d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ace1c0f9-578b-45e1-9474-010ea4f3be36 tempest-VolumesSnapshotTestJSON-2131569175 None] Created volume successfully. Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-e9cadd08-640a-4928-9270-e1ee04f5fcc5-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-e9cadd08-640a-4928-9270-e1ee04f5fcc5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-e9cadd08-640a-4928-9270-e1ee04f5fcc5" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-e9cadd08-640a-4928-9270-e1ee04f5fcc5" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1763aad-90b8-459f-b2cf-e103b5ca795f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:24 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 1073741824" returned: 0 in 1.177s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:24 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 Jul 11 18:47:24 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:24 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 Jul 11 18:47:24 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:25 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09" returned: 0 in 1.185s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.436s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:25 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5" returned: 0 in 1.326s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61f1e15-8d2b-4eb6-b864-dbc3c9fa980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:25 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5 Jul 11 18:47:25 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4792b54-5eb6-4c16-9eec-f2ea215928f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Volume volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 (a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09): created successfully Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4792b54-5eb6-4c16-9eec-f2ea215928f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Flow 'volume_create_manager' (982ce11d-18c9-4b44-8821-ad30be3648e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0b56fd6d-4434-41cf-8707-d8bf26e8aa6d tempest-TestMinimumBasicScenario-1497529290 None] Created volume successfully. Jul 11 18:47:26 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e9cadd08-640a-4928-9270-e1ee04f5fcc5" returned: 0 in 0.806s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-e9cadd08-640a-4928-9270-e1ee04f5fcc5" released by "delete_volume" :: held 2.215s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Created reservations ['bf20406d-43ee-4682-ac4a-1ed5d1efc5fb', '9d791d94-c4de-464c-920e-fc27e243b512', '37b2ff57-ff77-4d37-a91f-40d3358f7b19', '1d0db4c2-4875-4171-a189-d5749e699101'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:26 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:47:26 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-e0c26551-c968-46d6-8158-1653547ebd5a req-e8f89902-1609-470a-8ec7-e87c82f33a41 tempest-AttachVolumeTestJSON-1769326654 None] Terminate volume connection completed successfully. Jul 11 18:47:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-e0c26551-c968-46d6-8158-1653547ebd5a req-e8f89902-1609-470a-8ec7-e87c82f33a41 tempest-AttachVolumeTestJSON-1769326654 None] Deleting attachment 4ae15ff0-d4be-49d6-b889-073ce76f7bcf. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:47:27 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.871s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Deleted volume successfully. Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79ddbbcc-4a36-4dcb-8929-79d5ded5edfb tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-e9cadd08-640a-4928-9270-e1ee04f5fcc5-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-90eda20f-529b-4ef3-96dc-a8053141bc07-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-90eda20f-529b-4ef3-96dc-a8053141bc07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-af3bdc48-6b02-41b6-addb-c5ddabfd568e" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-af3bdc48-6b02-41b6-addb-c5ddabfd568e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-90eda20f-529b-4ef3-96dc-a8053141bc07" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-90eda20f-529b-4ef3-96dc-a8053141bc07" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Deleting offline snapshot 90eda20f-529b-4ef3-96dc-a8053141bc07 of volume af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] snapshot_file for this snap is: volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1192b5-4d3a-451e-bc68-fc2ee3d6eb5b]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:27 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 Jul 11 18:47:27 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:28 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07" returned: 0 in 0.944s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:47:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc27bd94-ba95-4d50-9f10-86ea8d796684]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:28 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e Jul 11 18:47:28 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:29 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e" returned: 0 in 0.864s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:29 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 Jul 11 18:47:29 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-937fa92f-cca1-4ebe-85de-1b7acd0ac0bb req-0b811011-c7a7-4f54-9afa-86e70d538787 tempest-TestMinimumBasicScenario-1497529290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-937fa92f-cca1-4ebe-85de-1b7acd0ac0bb req-0b811011-c7a7-4f54-9afa-86e70d538787 tempest-TestMinimumBasicScenario-1497529290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1b7782-3a31-4f7c-88f0-7f5aaf6249eb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-937fa92f-cca1-4ebe-85de-1b7acd0ac0bb req-0b811011-c7a7-4f54-9afa-86e70d538787 tempest-TestMinimumBasicScenario-1497529290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:30 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 Jul 11 18:47:30 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:30 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07" returned: 0 in 1.019s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:30 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07 Jul 11 18:47:30 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:30 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-937fa92f-cca1-4ebe-85de-1b7acd0ac0bb req-0b811011-c7a7-4f54-9afa-86e70d538787 tempest-TestMinimumBasicScenario-1497529290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09" returned: 0 in 1.006s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-937fa92f-cca1-4ebe-85de-1b7acd0ac0bb req-0b811011-c7a7-4f54-9afa-86e70d538787 tempest-TestMinimumBasicScenario-1497529290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.036s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-937fa92f-cca1-4ebe-85de-1b7acd0ac0bb req-0b811011-c7a7-4f54-9afa-86e70d538787 tempest-TestMinimumBasicScenario-1497529290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8338dc2b-d5eb-4c8c-ac7f-5fd155622152', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:47:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-937fa92f-cca1-4ebe-85de-1b7acd0ac0bb req-0b811011-c7a7-4f54-9afa-86e70d538787 tempest-TestMinimumBasicScenario-1497529290 None] attachment_update completed successfully. Jul 11 18:47:31 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e.90eda20f-529b-4ef3-96dc-a8053141bc07" returned: 0 in 0.816s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-90eda20f-529b-4ef3-96dc-a8053141bc07" released by "_delete_snapshot" :: held 3.764s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-af3bdc48-6b02-41b6-addb-c5ddabfd568e" released by "delete_snapshot" :: held 3.793s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:31 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Created reservations ['71e9ffe2-68c1-4713-bfb1-c7fcd2c9c1f1', 'abee4b04-f069-45e2-9da9-973c78c77df8', 'f5117835-760b-44b6-b135-f2da61b7cf4b', '0af2ec8f-f709-4541-b683-b24569d2af1f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Delete snapshot completed successfully. Jul 11 18:47:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73c252bf-28ef-4ea0-8d53-993900257a14 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-90eda20f-529b-4ef3-96dc-a8053141bc07-delete_snapshot" released by "delete_snapshot" :: held 3.997s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-af3bdc48-6b02-41b6-addb-c5ddabfd568e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-af3bdc48-6b02-41b6-addb-c5ddabfd568e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-af3bdc48-6b02-41b6-addb-c5ddabfd568e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-af3bdc48-6b02-41b6-addb-c5ddabfd568e" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6058e5-e2eb-4e7a-9ab9-50ec1bdcc365]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:32 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e Jul 11 18:47:32 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:33 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e" returned: 0 in 1.102s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:33 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e Jul 11 18:47:33 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:34 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-af3bdc48-6b02-41b6-addb-c5ddabfd568e" returned: 0 in 1.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-af3bdc48-6b02-41b6-addb-c5ddabfd568e" released by "delete_volume" :: held 2.281s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Created reservations ['b4e8b88b-5dfc-484a-ac91-cb1f937dc994', '47bf3d34-0413-448b-a2d7-a1e501a3ba29', 'ff744e9f-3222-4e3a-ab6d-e10a149bf8a9', '4896e209-f7fd-43d5-9b40-c808d9cd56ea'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:34 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:47:34 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:35 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.948s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:35 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Deleted volume successfully. Jul 11 18:47:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4ae6b17-96e6-4ad1-8831-148774d33aa8 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-af3bdc48-6b02-41b6-addb-c5ddabfd568e-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (08e41875-7f3b-497f-9075-312566708837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a8fdd5-ded1-4148-8f62-a2438875124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a8fdd5-ded1-4148-8f62-a2438875124d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-872586146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823c8e25-95ae-47bb-8189-7bd690c65f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09751447432471e8a9412f98023a8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:36Z,use_quota=True,user_id='66d349e5dbd24cbaada0d021f22545fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f66e7c-0195-4d68-9554-aadce480d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f66e7c-0195-4d68-9554-aadce480d198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b635e90c-0eee-4cc8-aaee-513d74a2f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b635e90c-0eee-4cc8-aaee-513d74a2f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823c8e25-95ae-47bb-8189-7bd690c65f6d', 'volume_name': 'volume-823c8e25-95ae-47bb-8189-7bd690c65f6d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d481bd-c88a-4507-9d32-3f68842c3902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d481bd-c88a-4507-9d32-3f68842c3902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4142bc7-6be1-4878-b9a4-f5f2dc2da273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:36 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume 823c8e25-95ae-47bb-8189-7bd690c65f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823c8e25-95ae-47bb-8189-7bd690c65f6d', 'volume_size': 1} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-872586146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823c8e25-95ae-47bb-8189-7bd690c65f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09751447432471e8a9412f98023a8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:36Z,use_quota=True,user_id='66d349e5dbd24cbaada0d021f22545fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Creating volume 823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:47:36 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:47:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:36 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d 1073741824 Jul 11 18:47:36 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:37 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d 1073741824" returned: 0 in 1.192s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:37 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d Jul 11 18:47:37 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:38 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d" returned: 0 in 0.762s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:47:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4142bc7-6be1-4878-b9a4-f5f2dc2da273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823c8e25-95ae-47bb-8189-7bd690c65f6d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49003c8-7dd3-47a4-84d2-73925b17eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Volume volume-823c8e25-95ae-47bb-8189-7bd690c65f6d (823c8e25-95ae-47bb-8189-7bd690c65f6d): created successfully Jul 11 18:47:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49003c8-7dd3-47a4-84d2-73925b17eeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (08e41875-7f3b-497f-9075-312566708837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b5b47b53-e4cc-48c7-b2cb-976fb0ca5e18 tempest-VolumesSnapshotTestJSON-2131569175 None] Created volume successfully. Jul 11 18:47:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Creating offline snapshot cf82586c-22be-4a1f-abaf-37e22b2e45a8 of volume 823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:47:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9e1231-6306-420c-8be9-985d7d82f98d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:40 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d Jul 11 18:47:40 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:41 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d" returned: 0 in 1.139s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:41 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 1G Jul 11 18:47:41 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:42 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 1G" returned: 0 in 1.478s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823c8e25-95ae-47bb-8189-7bd690c65f6d -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:42 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823c8e25-95ae-47bb-8189-7bd690c65f6d -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 Jul 11 18:47:42 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:43 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823c8e25-95ae-47bb-8189-7bd690c65f6d -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8" returned: 0 in 1.104s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:43 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 is being set with open permissions: ugo+rw Jul 11 18:47:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:43 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 Jul 11 18:47:43 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:44 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8" returned: 0 in 0.930s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:44 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.info Jul 11 18:47:44 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:45 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.info" returned: 0 in 0.961s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:45 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.info is being set with open permissions: ugo+rw Jul 11 18:47:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:45 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.info Jul 11 18:47:45 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:46 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.info" returned: 0 in 0.935s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.747s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1b729a96-e4cd-4d1e-a928-c36bbff34cc4 tempest-VolumesSnapshotTestJSON-2131569175 None] Create snapshot completed successfully Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (97580e9e-49f9-4462-82ca-e5905861e02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb2a642-c1a4-43d0-b3d9-798f28650ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb2a642-c1a4-43d0-b3d9-798f28650ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1922392485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1bd0bf-b670-4285-a28b-09ab352d43a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09751447432471e8a9412f98023a8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf82586c-22be-4a1f-abaf-37e22b2e45a8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:48Z,use_quota=True,user_id='66d349e5dbd24cbaada0d021f22545fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6589d143-4e9a-4f34-bf4b-11207432c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6589d143-4e9a-4f34-bf4b-11207432c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa0fa68-cf47-4288-ba66-b8edc57ea9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa0fa68-cf47-4288-ba66-b8edc57ea9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a1bd0bf-b670-4285-a28b-09ab352d43a4', 'volume_name': 'volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4', 'volume_size': 1, 'snapshot_id': 'cf82586c-22be-4a1f-abaf-37e22b2e45a8'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913871ba-cbcf-4902-bd6b-8c4dc10826eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913871ba-cbcf-4902-bd6b-8c4dc10826eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd70b25-f81c-445d-a577-4f5691b81568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Volume 7a1bd0bf-b670-4285-a28b-09ab352d43a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4', 'volume_size': 1, 'snapshot_id': 'cf82586c-22be-4a1f-abaf-37e22b2e45a8'} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-cf82586c-22be-4a1f-abaf-37e22b2e45a8-7a1bd0bf-b670-4285-a28b-09ab352d43a4" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cf82586c-22be-4a1f-abaf-37e22b2e45a8-7a1bd0bf-b670-4285-a28b-09ab352d43a4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Creating volume 7a1bd0bf-b670-4285-a28b-09ab352d43a4 from snapshot cf82586c-22be-4a1f-abaf-37e22b2e45a8 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-7a1bd0bf-b670-4285-a28b-09ab352d43a4" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-7a1bd0bf-b670-4285-a28b-09ab352d43a4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] snapshot: cf82586c-22be-4a1f-abaf-37e22b2e45a8, volume: 7a1bd0bf-b670-4285-a28b-09ab352d43a4, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[696b0cfe-1e12-4036-9c3e-0e93f95d288e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:48 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 Jul 11 18:47:48 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:49 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8" returned: 0 in 1.003s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-823c8e25-95ae-47bb-8189-7bd690c65f6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:47:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:47:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:47:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf3280b-b572-40cd-abe1-949fa1ac6d07]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:49 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d Jul 11 18:47:49 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:50 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d" returned: 0 in 1.044s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:50 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:47:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:50 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 Jul 11 18:47:50 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:58 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4" returned: 0 in 7.268s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27e5810-82e2-4c9c-b9c9-5bddb2959237]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:58 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d Jul 11 18:47:58 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:58 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=34,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:47:58 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=30,cinder:UPDATE=30,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:47:59 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d" returned: 0 in 0.965s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:47:59 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Converted 1024.00 MB image at 140.88 MB/s Jul 11 18:47:59 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 is being set with open permissions: ugo+rw Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:59 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 Jul 11 18:47:59 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:59 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4" returned: 0 in 0.662s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-7a1bd0bf-b670-4285-a28b-09ab352d43a4" released by "_copy_volume_from_snapshot" :: held 11.080s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cf82586c-22be-4a1f-abaf-37e22b2e45a8-7a1bd0bf-b670-4285-a28b-09ab352d43a4" released by "_create_volume_from_snapshot" :: held 11.116s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.135s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd70b25-f81c-445d-a577-4f5691b81568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4', 'volume_size': 1, 'snapshot_id': 'cf82586c-22be-4a1f-abaf-37e22b2e45a8'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe992fea-1812-4204-9268-ce65890f0c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Volume volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 (7a1bd0bf-b670-4285-a28b-09ab352d43a4): created successfully Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe992fea-1812-4204-9268-ce65890f0c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Flow 'volume_create_manager' (97580e9e-49f9-4462-82ca-e5905861e02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-46b9b37c-103d-49de-ba77-881e3db3694c tempest-VolumesSnapshotTestJSON-2131569175 None] Created volume successfully. Jul 11 18:48:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-7a1bd0bf-b670-4285-a28b-09ab352d43a4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-7a1bd0bf-b670-4285-a28b-09ab352d43a4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-7a1bd0bf-b670-4285-a28b-09ab352d43a4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-7a1bd0bf-b670-4285-a28b-09ab352d43a4" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[645d99a6-644a-498a-8b3f-70d62afdf1fc]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:00 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 Jul 11 18:48:00 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:00 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4" returned: 0 in 0.780s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:00 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4 Jul 11 18:48:00 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:01 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a1bd0bf-b670-4285-a28b-09ab352d43a4" returned: 0 in 0.727s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-7a1bd0bf-b670-4285-a28b-09ab352d43a4" released by "delete_volume" :: held 1.558s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Created reservations ['e29522b1-7404-4c60-b60b-5db028fccd47', '81b21dd0-c8f7-4662-9e48-92a0a8447f6b', '457b9bad-2d47-49b6-80f6-27b8f9d1d18a', '465fed92-d55c-4ac9-9e3c-af7decd387cb'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:01 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:01 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-cf82586c-22be-4a1f-abaf-37e22b2e45a8-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-cf82586c-22be-4a1f-abaf-37e22b2e45a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-823c8e25-95ae-47bb-8189-7bd690c65f6d" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-823c8e25-95ae-47bb-8189-7bd690c65f6d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-cf82586c-22be-4a1f-abaf-37e22b2e45a8" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cf82586c-22be-4a1f-abaf-37e22b2e45a8" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Deleting offline snapshot cf82586c-22be-4a1f-abaf-37e22b2e45a8 of volume 823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] snapshot_file for this snap is: volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0880f5b-f046-4fa7-8f23-35ce82c486a5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:02 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 Jul 11 18:48:02 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:03 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.539s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:03 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Deleted volume successfully. Jul 11 18:48:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2800918f-2a4d-4686-97f0-3976344e8753 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-7a1bd0bf-b670-4285-a28b-09ab352d43a4-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:04 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8" returned: 0 in 1.418s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-823c8e25-95ae-47bb-8189-7bd690c65f6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:48:04 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce513215-b997-4907-b423-c70c58d5a125]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:04 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d Jul 11 18:48:04 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:05 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d" returned: 0 in 0.930s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:05 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 Jul 11 18:48:05 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:06 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8" returned: 0 in 1.089s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:06 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8 Jul 11 18:48:06 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:07 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d.cf82586c-22be-4a1f-abaf-37e22b2e45a8" returned: 0 in 0.775s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cf82586c-22be-4a1f-abaf-37e22b2e45a8" released by "_delete_snapshot" :: held 4.484s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-823c8e25-95ae-47bb-8189-7bd690c65f6d" released by "delete_snapshot" :: held 4.549s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Created reservations ['2d80bef9-5e39-4689-a07f-8dc05a7b256b', 'e2a17bba-34eb-4028-9bd1-06aad3a72c31', 'f9c53375-8871-4940-bbbe-0b52008dc1b7', '9b7da022-f175-4f9d-8c25-4edd803fbb0f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Delete snapshot completed successfully. Jul 11 18:48:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4beb50cc-5b50-4a19-b5b2-22b855725df3 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-cf82586c-22be-4a1f-abaf-37e22b2e45a8-delete_snapshot" released by "delete_snapshot" :: held 4.763s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-823c8e25-95ae-47bb-8189-7bd690c65f6d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-823c8e25-95ae-47bb-8189-7bd690c65f6d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-823c8e25-95ae-47bb-8189-7bd690c65f6d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-823c8e25-95ae-47bb-8189-7bd690c65f6d" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc729b1e-f953-4a9a-bf84-2235cca4bbea]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:08 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d Jul 11 18:48:08 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:09 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d" returned: 0 in 1.311s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:09 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d Jul 11 18:48:09 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:10 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-823c8e25-95ae-47bb-8189-7bd690c65f6d" returned: 0 in 1.115s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-823c8e25-95ae-47bb-8189-7bd690c65f6d" released by "delete_volume" :: held 2.568s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:10 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Created reservations ['4f71692e-20ac-401a-a717-5862f968d1df', '2ec0da6a-8922-4731-888a-dddf94cc9373', 'e8da2d4b-3ceb-450a-b308-2d84292be7d1', '4b2ef932-fb72-48fd-9265-2b2f470b52ac'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:11 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:11 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-cbc99b16-c0b2-48fc-af5d-657ab373a9cc-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-cbc99b16-c0b2-48fc-af5d-657ab373a9cc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "cinder-quobyte-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" acquired by "delete_volume" :: waited 0.044s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8ee07b-8cf9-4362-b8dc-fbfc4feb8140]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:11 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.947s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Deleted volume successfully. Jul 11 18:48:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9d3b1f37-2b10-4730-aa98-624f3e619d2a tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-823c8e25-95ae-47bb-8189-7bd690c65f6d-delete_volume" released by "delete_volume" :: held 3.868s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:12 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc Jul 11 18:48:12 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:12 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" returned: 0 in 0.903s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:12 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc Jul 11 18:48:12 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:13 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" returned: 0 in 0.779s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-quobyte-cbc99b16-c0b2-48fc-af5d-657ab373a9cc" released by "delete_volume" :: held 1.812s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Created reservations ['249131b6-ff8c-456f-94ad-e59e89954126', '95fb7e2e-8875-4e93-b4e3-3bbac1fa3467', '44d60d94-d3bd-474d-8829-99c345b13a36', '86a0d80a-a6dd-411a-b14e-73ea98a0ea61'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:13 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:13 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:14 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.123s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Deleted volume successfully. Jul 11 18:48:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ba3e54f5-e3d7-4a38-888c-5ee744f6bdf9 tempest-VolumesSnapshotTestJSON-2131569175 None] Lock "cinder-cbc99b16-c0b2-48fc-af5d-657ab373a9cc-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:48:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:15 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:15 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:16 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.455s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (eb6bae4b-a9d2-4914-b465-005dabb0fcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581585d8-236f-47ae-8612-da9e20ffdb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581585d8-236f-47ae-8612-da9e20ffdb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-650303103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39378c5b-e810-4fe2-a216-ed7cec113c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:17Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a9419d-f45f-45c6-95c9-a1e761220ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a9419d-f45f-45c6-95c9-a1e761220ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2369748b-4857-4a04-b415-449b12cf2096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2369748b-4857-4a04-b415-449b12cf2096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39378c5b-e810-4fe2-a216-ed7cec113c93', 'volume_name': 'volume-39378c5b-e810-4fe2-a216-ed7cec113c93', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e58a2d6-15e7-499d-8496-2176a4e36588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e58a2d6-15e7-499d-8496-2176a4e36588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1dc8a4-18b7-4628-ac34-ab4c5c11ed8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Volume 39378c5b-e810-4fe2-a216-ed7cec113c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39378c5b-e810-4fe2-a216-ed7cec113c93', 'volume_size': 1} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-650303103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39378c5b-e810-4fe2-a216-ed7cec113c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:17Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Creating volume 39378c5b-e810-4fe2-a216-ed7cec113c93 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:16 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:16 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 1073741824 Jul 11 18:48:16 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:17 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 1073741824" returned: 0 in 1.162s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:17 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 Jul 11 18:48:17 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:18 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93" returned: 0 in 1.051s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1dc8a4-18b7-4628-ac34-ab4c5c11ed8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39378c5b-e810-4fe2-a216-ed7cec113c93', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd6eb65-5b73-4bea-a199-5f2fe0dbe307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:19 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Volume volume-39378c5b-e810-4fe2-a216-ed7cec113c93 (39378c5b-e810-4fe2-a216-ed7cec113c93): created successfully Jul 11 18:48:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd6eb65-5b73-4bea-a199-5f2fe0dbe307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (eb6bae4b-a9d2-4914-b465-005dabb0fcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9834b581-16be-4761-a696-d1e34e8087a0 tempest-VolumesActionsTest-662874814 None] Created volume successfully. Jul 11 18:48:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fc9e43c6-7234-4698-b9cd-8c325f7eabb4 tempest-VolumesActionsTest-662874814 None] Acquiring lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93" by "attach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fc9e43c6-7234-4698-b9cd-8c325f7eabb4 tempest-VolumesActionsTest-662874814 None] Lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93" acquired by "attach_volume" :: waited 0.048s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fc9e43c6-7234-4698-b9cd-8c325f7eabb4 tempest-VolumesActionsTest-662874814 None] Attaching volume 39378c5b-e810-4fe2-a216-ed7cec113c93 to instance 9d2a99d9-a2ee-4c2a-a5f7-350631fbb10d at mountpoint /dev/vdb on host None. Jul 11 18:48:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fc9e43c6-7234-4698-b9cd-8c325f7eabb4 tempest-VolumesActionsTest-662874814 None] Attach volume completed successfully. Jul 11 18:48:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fc9e43c6-7234-4698-b9cd-8c325f7eabb4 tempest-VolumesActionsTest-662874814 None] Lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93" released by "attach_volume" :: held 0.184s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-13a0781f-98e1-4b9e-866a-5cdba82e3a0b tempest-VolumesActionsTest-621447175 None] Terminate volume connection completed successfully. Jul 11 18:48:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-13a0781f-98e1-4b9e-866a-5cdba82e3a0b tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-detach_volume" by "detach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-13a0781f-98e1-4b9e-866a-5cdba82e3a0b tempest-VolumesActionsTest-621447175 None] Lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-13a0781f-98e1-4b9e-866a-5cdba82e3a0b tempest-VolumesActionsTest-621447175 None] Detaching volume 39378c5b-e810-4fe2-a216-ed7cec113c93 from instance 9d2a99d9-a2ee-4c2a-a5f7-350631fbb10d. Jul 11 18:48:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-13a0781f-98e1-4b9e-866a-5cdba82e3a0b tempest-VolumesActionsTest-621447175 None] Detach volume completed successfully. Jul 11 18:48:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-13a0781f-98e1-4b9e-866a-5cdba82e3a0b tempest-VolumesActionsTest-621447175 None] Lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a9131b56-4286-4fc9-9aa3-208a6ac0677a tempest-VolumesActionsTest-662874814 None] Acquiring lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-detach_volume" by "detach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a9131b56-4286-4fc9-9aa3-208a6ac0677a tempest-VolumesActionsTest-662874814 None] Lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a9131b56-4286-4fc9-9aa3-208a6ac0677a tempest-VolumesActionsTest-662874814 None] Volume detach called, but volume not attached. Jul 11 18:48:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a9131b56-4286-4fc9-9aa3-208a6ac0677a tempest-VolumesActionsTest-662874814 None] Lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Acquiring lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Acquiring lock "cinder-quobyte-39378c5b-e810-4fe2-a216-ed7cec113c93" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Lock "cinder-quobyte-39378c5b-e810-4fe2-a216-ed7cec113c93" acquired by "delete_volume" :: waited 0.084s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (9a20bd6f-c5c3-42c8-ba77-29f63339626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e113dc4b-9b8c-48c3-ae13-807af23fd123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b2502-6d2e-4ae4-925f-04b9b2748b58]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e113dc4b-9b8c-48c3-ae13-807af23fd123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384685000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0462e4bd-eea4-4bbd-ad00-2484d3379954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:24Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ed9269-563f-46a1-9538-0b00c2a210b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ed9269-563f-46a1-9538-0b00c2a210b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee07f425-3ccb-4498-a582-811b94714e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee07f425-3ccb-4498-a582-811b94714e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0462e4bd-eea4-4bbd-ad00-2484d3379954', 'volume_name': 'volume-0462e4bd-eea4-4bbd-ad00-2484d3379954', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c265fe61-5e5c-41d9-a20b-2f4f32a8e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c265fe61-5e5c-41d9-a20b-2f4f32a8e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0825a0e4-44fd-4885-8c40-e7ab4bb425ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Volume 0462e4bd-eea4-4bbd-ad00-2484d3379954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0462e4bd-eea4-4bbd-ad00-2484d3379954', 'volume_size': 1} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384685000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0462e4bd-eea4-4bbd-ad00-2484d3379954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:24Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Creating volume 0462e4bd-eea4-4bbd-ad00-2484d3379954 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:24 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:24 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 Jul 11 18:48:24 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:24 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 1073741824 Jul 11 18:48:24 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (298399fe-736c-42b6-b70a-abd6b061d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e9c9da-93b2-43fd-9ae9-e6fd32cb8803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e9c9da-93b2-43fd-9ae9-e6fd32cb8803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883247593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0155c78b-a521-4702-b0df-e49d876bbbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:24Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b81ecb-1d5b-45e7-a0ef-0dc418529470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b81ecb-1d5b-45e7-a0ef-0dc418529470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea706e33-799c-457f-ad30-753c0bf81417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea706e33-799c-457f-ad30-753c0bf81417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0155c78b-a521-4702-b0df-e49d876bbbcd', 'volume_name': 'volume-0155c78b-a521-4702-b0df-e49d876bbbcd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cf7ab0-4b59-4739-9728-3d701158f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cf7ab0-4b59-4739-9728-3d701158f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da98ab0-8a2d-412d-84c0-e6b803820975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Volume 0155c78b-a521-4702-b0df-e49d876bbbcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0155c78b-a521-4702-b0df-e49d876bbbcd', 'volume_size': 1} Jul 11 18:48:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (7ca5fd5f-f379-42aa-ab45-c615b555806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22d317a-b6e6-48b0-8fef-512612bc4b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22d317a-b6e6-48b0-8fef-512612bc4b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131701197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06847663-5768-42fb-ac5d-493845ccced2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:25Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246e4ed1-30fe-4e49-8a62-a7f055d3294e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246e4ed1-30fe-4e49-8a62-a7f055d3294e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a096eef-b3eb-4b71-a9a0-531704f1f0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a096eef-b3eb-4b71-a9a0-531704f1f0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06847663-5768-42fb-ac5d-493845ccced2', 'volume_name': 'volume-06847663-5768-42fb-ac5d-493845ccced2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd8b103-3116-42f2-aad9-5c33efefa031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd8b103-3116-42f2-aad9-5c33efefa031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ea81be-4e36-49f2-a62b-8c83ece278e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Volume 06847663-5768-42fb-ac5d-493845ccced2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06847663-5768-42fb-ac5d-493845ccced2', 'volume_size': 1} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:25 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93" returned: 0 in 1.650s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:25 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93 Jul 11 18:48:25 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (17dda561-4ae6-4d8e-888f-f773aed00810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb950a7-8875-41ab-b0c6-d699c27a95ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb950a7-8875-41ab-b0c6-d699c27a95ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235943465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f079673c-b135-4710-9ad4-8e8169950e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:26Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f9cb10-0e74-4cd1-bdfd-e3df27035a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f9cb10-0e74-4cd1-bdfd-e3df27035a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc99e4c-afec-446d-a2d4-31543864535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:25 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc99e4c-afec-446d-a2d4-31543864535a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f079673c-b135-4710-9ad4-8e8169950e02', 'volume_name': 'volume-f079673c-b135-4710-9ad4-8e8169950e02', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a033c5fa-9d4e-49c6-b3ff-fce5e17cb26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a033c5fa-9d4e-49c6-b3ff-fce5e17cb26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ac683-da72-4d2c-bfef-1d4f57b0a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Volume f079673c-b135-4710-9ad4-8e8169950e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f079673c-b135-4710-9ad4-8e8169950e02', 'volume_size': 1} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 1073741824" returned: 0 in 1.704s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:26 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 Jul 11 18:48:26 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (ab690fb4-4c15-474f-ab1d-b5baf7fbf7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e6f3da-3320-4a59-abc6-d35ef594dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e6f3da-3320-4a59-abc6-d35ef594dea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1994117524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e171852b-bc36-4f24-a582-39bb93533f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:26Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcd8fb5-9cae-4cb2-ac49-5ad0f7daf2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcd8fb5-9cae-4cb2-ac49-5ad0f7daf2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1776ca7b-624c-45aa-a8fa-1d793f51dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1776ca7b-624c-45aa-a8fa-1d793f51dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e171852b-bc36-4f24-a582-39bb93533f9a', 'volume_name': 'volume-e171852b-bc36-4f24-a582-39bb93533f9a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6625c2-e3dd-4757-84ff-f357002a6e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6625c2-e3dd-4757-84ff-f357002a6e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4049db1e-db6c-4165-a436-0c4191c63a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Volume e171852b-bc36-4f24-a582-39bb93533f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e171852b-bc36-4f24-a582-39bb93533f9a', 'volume_size': 1} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:26 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-39378c5b-e810-4fe2-a216-ed7cec113c93" returned: 0 in 1.156s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Lock "cinder-quobyte-39378c5b-e810-4fe2-a216-ed7cec113c93" released by "delete_volume" :: held 3.030s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Created reservations ['5265f5ac-2d17-4910-ac88-a5302d5c30b2', '16be454b-67a3-4cc2-833e-ca17708f2417', '6ba20ab9-f73f-44d4-8786-70e92606c223', '7da9f10a-3595-496f-adf2-758aa1360d0c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:27 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:27 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:27 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954" returned: 0 in 1.075s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] <== create_volume: return (2855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.857s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.341s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883247593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0155c78b-a521-4702-b0df-e49d876bbbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:24Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Creating volume 0155c78b-a521-4702-b0df-e49d876bbbcd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:27 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:27 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd 1073741824 Jul 11 18:48:27 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0825a0e4-44fd-4885-8c40-e7ab4bb425ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0462e4bd-eea4-4bbd-ad00-2484d3379954', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e8fa54-1103-459a-b79d-f2407f6675c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:27 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Volume volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 (0462e4bd-eea4-4bbd-ad00-2484d3379954): created successfully Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e8fa54-1103-459a-b79d-f2407f6675c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (9a20bd6f-c5c3-42c8-ba77-29f63339626a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-75a4b4a5-7962-4e60-a82d-01c1dda044ac tempest-CreateVolumesFromImageTest-159923596 None] Created volume successfully. Jul 11 18:48:27 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.811s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:27 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Deleted volume successfully. Jul 11 18:48:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-95f5715e-4adf-476b-bd52-c4863d4bad46 tempest-VolumesActionsTest-662874814 None] Lock "cinder-39378c5b-e810-4fe2-a216-ed7cec113c93-delete_volume" released by "delete_volume" :: held 4.222s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:28 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd 1073741824" returned: 0 in 1.541s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:28 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd Jul 11 18:48:28 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:29 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd" returned: 0 in 1.060s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] <== create_volume: return (2696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.325s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131701197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06847663-5768-42fb-ac5d-493845ccced2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:25Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Creating volume 06847663-5768-42fb-ac5d-493845ccced2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:29 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da98ab0-8a2d-412d-84c0-e6b803820975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0155c78b-a521-4702-b0df-e49d876bbbcd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:29 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 1073741824 Jul 11 18:48:29 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cd0e5e-9d62-4c85-a0af-4c9930d3c082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Volume volume-0155c78b-a521-4702-b0df-e49d876bbbcd (0155c78b-a521-4702-b0df-e49d876bbbcd): created successfully Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cd0e5e-9d62-4c85-a0af-4c9930d3c082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (298399fe-736c-42b6-b70a-abd6b061d21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3eab6e33-78ca-4ccf-8fc2-8f4cb414fd5a tempest-CreateVolumesFromImageTest-159923596 None] Created volume successfully. Jul 11 18:48:31 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 1073741824" returned: 0 in 1.132s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:31 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 Jul 11 18:48:31 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:31 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2" returned: 0 in 0.684s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.733s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235943465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f079673c-b135-4710-9ad4-8e8169950e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:26Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Creating volume f079673c-b135-4710-9ad4-8e8169950e02 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ea81be-4e36-49f2-a62b-8c83ece278e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06847663-5768-42fb-ac5d-493845ccced2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a30b6e-f4de-4835-85de-c04844305f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:31 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 1073741824 Jul 11 18:48:31 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Volume volume-06847663-5768-42fb-ac5d-493845ccced2 (06847663-5768-42fb-ac5d-493845ccced2): created successfully Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a30b6e-f4de-4835-85de-c04844305f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (7ca5fd5f-f379-42aa-ab45-c615b555806e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a02c4fe7-7335-4a27-ab5e-743a19be13e9 tempest-CreateVolumesFromImageTest-159923596 None] Created volume successfully. Jul 11 18:48:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-9b84e3f5-fd96-4ffd-b5b2-cf73ac7edde9 req-a2a32466-e0b1-4db5-9325-c7f36973f2a9 tempest-TestMinimumBasicScenario-1497529290 None] Terminate volume connection completed successfully. Jul 11 18:48:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-9b84e3f5-fd96-4ffd-b5b2-cf73ac7edde9 req-a2a32466-e0b1-4db5-9325-c7f36973f2a9 tempest-TestMinimumBasicScenario-1497529290 None] Deleting attachment 8338dc2b-d5eb-4c8c-ac7f-5fd155622152. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:48:32 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 1073741824" returned: 0 in 1.017s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:32 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 Jul 11 18:48:32 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:33 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02" returned: 0 in 0.770s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.853s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1994117524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e171852b-bc36-4f24-a582-39bb93533f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99132502b16649c099cb597bc267dd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:26Z,use_quota=True,user_id='dac0a6479fc245048bdca2c98b86c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Creating volume e171852b-bc36-4f24-a582-39bb93533f9a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ac683-da72-4d2c-bfef-1d4f57b0a58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f079673c-b135-4710-9ad4-8e8169950e02', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:33 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a 1073741824 Jul 11 18:48:33 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82d15bf-dd45-4ebb-ad6d-dd9ede1f9dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Volume volume-f079673c-b135-4710-9ad4-8e8169950e02 (f079673c-b135-4710-9ad4-8e8169950e02): created successfully Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82d15bf-dd45-4ebb-ad6d-dd9ede1f9dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (17dda561-4ae6-4d8e-888f-f773aed00810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ce7939cb-3548-49d7-822f-8c72869d8913 tempest-CreateVolumesFromImageTest-159923596 None] Created volume successfully. Jul 11 18:48:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Acquiring lock "cinder-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Lock "cinder-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Acquiring lock "cinder-quobyte-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Lock "cinder-quobyte-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e19140-8298-4c75-8c82-f50b31927698]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:34 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 Jul 11 18:48:34 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:34 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a 1073741824" returned: 0 in 1.187s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:34 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a Jul 11 18:48:34 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:35 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09" returned: 0 in 0.906s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:35 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09 Jul 11 18:48:35 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (9dd9d91e-545f-456a-b459-df70f70fca2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3697c17-8171-418d-9b57-35202448782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3697c17-8171-418d-9b57-35202448782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1176346645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60315a71-be30-4fdf-a43e-34ee37df54db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:36Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fe5d26-66d5-42ee-8db1-6b8ec642adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fe5d26-66d5-42ee-8db1-6b8ec642adf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3005e577-1192-4c16-94f7-145e50f59ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3005e577-1192-4c16-94f7-145e50f59ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60315a71-be30-4fdf-a43e-34ee37df54db', 'volume_name': 'volume-60315a71-be30-4fdf-a43e-34ee37df54db', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054b5913-9095-423b-9210-8104be1e1014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:35 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054b5913-9095-423b-9210-8104be1e1014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8a951b-4f78-4d96-8de9-4d79535a0b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Volume 60315a71-be30-4fdf-a43e-34ee37df54db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60315a71-be30-4fdf-a43e-34ee37df54db', 'volume_size': 1} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a" returned: 0 in 0.902s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1176346645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60315a71-be30-4fdf-a43e-34ee37df54db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:36Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Creating volume 60315a71-be30-4fdf-a43e-34ee37df54db {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:35 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4049db1e-db6c-4165-a436-0c4191c63a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e171852b-bc36-4f24-a582-39bb93533f9a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f745ef09-89ec-4c30-8667-473dba399470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:35 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db 1073741824 Jul 11 18:48:35 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Volume volume-e171852b-bc36-4f24-a582-39bb93533f9a (e171852b-bc36-4f24-a582-39bb93533f9a): created successfully Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f745ef09-89ec-4c30-8667-473dba399470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Flow 'volume_create_manager' (ab690fb4-4c15-474f-ab1d-b5baf7fbf7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-661418f5-36fb-415c-9ef9-cf121acde6b5 tempest-CreateVolumesFromImageTest-159923596 None] Created volume successfully. Jul 11 18:48:36 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09" returned: 0 in 0.922s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Lock "cinder-quobyte-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09" released by "delete_volume" :: held 1.914s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Created reservations ['25dbd067-c9a7-4de1-8547-958c8103f618', 'ff572573-d53f-469f-8e00-1625f7b4579b', 'c806cc12-ab30-42df-be10-b857e51db731', '3131af00-1b02-4a5c-b6ee-9359f8e00ff4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:36 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:36 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-e171852b-bc36-4f24-a582-39bb93533f9a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-e171852b-bc36-4f24-a582-39bb93533f9a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-quobyte-e171852b-bc36-4f24-a582-39bb93533f9a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-e171852b-bc36-4f24-a582-39bb93533f9a" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:37 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc2d4ab-35d3-4ab9-af67-51a64150877a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:37 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db 1073741824" returned: 0 in 1.372s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:37 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a Jul 11 18:48:37 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:37 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db Jul 11 18:48:37 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:37 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.388s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Deleted volume successfully. Jul 11 18:48:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-899b1427-f4bb-4ae7-bd07-ff9d506b29e7 tempest-TestMinimumBasicScenario-1497529290 None] Lock "cinder-a0f8ecbd-753a-4d08-9a0c-f3c2d676fa09-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:38 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db" returned: 0 in 0.843s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8a951b-4f78-4d96-8de9-4d79535a0b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60315a71-be30-4fdf-a43e-34ee37df54db', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9888fc-90f8-4c68-90cb-7167ea370322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Volume volume-60315a71-be30-4fdf-a43e-34ee37df54db (60315a71-be30-4fdf-a43e-34ee37df54db): created successfully Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9888fc-90f8-4c68-90cb-7167ea370322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (9dd9d91e-545f-456a-b459-df70f70fca2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-39973ac5-4fdc-49e3-80e5-50e876d929f2 tempest-VolumesActionsTest-662874814 None] Created volume successfully. Jul 11 18:48:38 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a" returned: 0 in 1.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:38 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a Jul 11 18:48:38 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-60315a71-be30-4fdf-a43e-34ee37df54db-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Lock "cinder-60315a71-be30-4fdf-a43e-34ee37df54db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-quobyte-60315a71-be30-4fdf-a43e-34ee37df54db" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Lock "cinder-quobyte-60315a71-be30-4fdf-a43e-34ee37df54db" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba0a601-2f5d-41f9-a849-e442e85f7e66]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:39 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e171852b-bc36-4f24-a582-39bb93533f9a" returned: 0 in 1.301s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:39 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db Jul 11 18:48:39 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-e171852b-bc36-4f24-a582-39bb93533f9a" released by "delete_volume" :: held 2.698s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Created reservations ['81d17a24-f60a-41d1-b798-ac86d6b01a9a', '8d85426a-9ab3-4473-b00b-55a928a079f3', '0ef5237b-8902-4542-bfb3-ac054fb0e4ec', 'fc0a60f9-9664-42c3-a6a1-91a213599038'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:40 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:40 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-f079673c-b135-4710-9ad4-8e8169950e02-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-f079673c-b135-4710-9ad4-8e8169950e02-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-quobyte-f079673c-b135-4710-9ad4-8e8169950e02" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-f079673c-b135-4710-9ad4-8e8169950e02" acquired by "delete_volume" :: waited 0.072s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:40 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db" returned: 0 in 1.377s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e991e030-a3c5-452d-95d2-e5b819999f87]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:40 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db Jul 11 18:48:40 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:41 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 Jul 11 18:48:41 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:41 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.424s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Deleted volume successfully. Jul 11 18:48:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2807424f-0283-4071-b33f-c203d10e17c6 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-e171852b-bc36-4f24-a582-39bb93533f9a-delete_volume" released by "delete_volume" :: held 4.558s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:42 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02" returned: 0 in 1.170s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:42 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-60315a71-be30-4fdf-a43e-34ee37df54db" returned: 0 in 1.218s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:42 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02 Jul 11 18:48:42 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Lock "cinder-quobyte-60315a71-be30-4fdf-a43e-34ee37df54db" released by "delete_volume" :: held 2.692s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Created reservations ['10ae5c78-85ed-4aaf-ab46-45d3e0c345f5', '05bebcd8-961c-4174-8a3c-8cd66f036daf', '1ac5de58-6875-4968-bc95-46f5e3c06288', '5bbc83db-2b08-48fd-a166-0bf79897c62b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:42 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:42 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:43 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f079673c-b135-4710-9ad4-8e8169950e02" returned: 0 in 1.014s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-f079673c-b135-4710-9ad4-8e8169950e02" released by "delete_volume" :: held 2.338s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:43 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.910s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Deleted volume successfully. Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f370672f-c9b6-4ef0-8d67-4b7804f00be0 tempest-VolumesActionsTest-621447175 None] Lock "cinder-60315a71-be30-4fdf-a43e-34ee37df54db-delete_volume" released by "delete_volume" :: held 3.929s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Created reservations ['b469dfca-d228-455c-91a7-79ff826f5734', '95f9287d-6a98-4b87-ab5b-0fe9705ddc3f', 'b9643edf-78b7-4376-9442-6adbb78c6232', '2a915092-7dd5-470a-9702-9ba6d74507c7'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:43 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:43 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (4805f763-d25a-431c-a608-30abb5685744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89cf805-df40-41a8-9b19-6f5958b60c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89cf805-df40-41a8-9b19-6f5958b60c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-411156833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31e94ba-ce65-40ce-aa63-aceed149433a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:44Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a26f70f-b67b-488a-b797-317ce7703b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a26f70f-b67b-488a-b797-317ce7703b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f107be2-6c3c-4c27-93ed-fd792cd77783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f107be2-6c3c-4c27-93ed-fd792cd77783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31e94ba-ce65-40ce-aa63-aceed149433a', 'volume_name': 'volume-c31e94ba-ce65-40ce-aa63-aceed149433a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e3e42b-ec47-48f8-a83f-2e27008869e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e3e42b-ec47-48f8-a83f-2e27008869e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1f2c25-39bb-4399-b60b-0835ca123d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Volume c31e94ba-ce65-40ce-aa63-aceed149433a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31e94ba-ce65-40ce-aa63-aceed149433a', 'volume_size': 1} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-411156833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31e94ba-ce65-40ce-aa63-aceed149433a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:44Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Creating volume c31e94ba-ce65-40ce-aa63-aceed149433a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:43 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a 1073741824 Jul 11 18:48:43 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:44 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.752s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Deleted volume successfully. Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-06847663-5768-42fb-ac5d-493845ccced2-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e8c032-2ff8-4bcf-96c9-76b9042cebfc tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-f079673c-b135-4710-9ad4-8e8169950e02-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-06847663-5768-42fb-ac5d-493845ccced2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-quobyte-06847663-5768-42fb-ac5d-493845ccced2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-06847663-5768-42fb-ac5d-493845ccced2" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a85a2-08dc-425e-ba70-81866003be81]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:44 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 Jul 11 18:48:44 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:44 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a 1073741824" returned: 0 in 1.141s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:45 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a Jul 11 18:48:45 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:45 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2" returned: 0 in 0.941s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:45 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2 Jul 11 18:48:45 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:45 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a" returned: 0 in 0.972s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1f2c25-39bb-4399-b60b-0835ca123d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31e94ba-ce65-40ce-aa63-aceed149433a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea86fbe2-a470-4cff-bdfb-b9efba44ca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Volume volume-c31e94ba-ce65-40ce-aa63-aceed149433a (c31e94ba-ce65-40ce-aa63-aceed149433a): created successfully Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea86fbe2-a470-4cff-bdfb-b9efba44ca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (4805f763-d25a-431c-a608-30abb5685744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a93dc352-8503-4dde-ad2a-d504f5483101 tempest-VolumesActionsTest-662874814 None] Created volume successfully. Jul 11 18:48:46 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-06847663-5768-42fb-ac5d-493845ccced2" returned: 0 in 0.874s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-06847663-5768-42fb-ac5d-493845ccced2" released by "delete_volume" :: held 1.867s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Created reservations ['5b474260-88a7-4837-ae76-b121a33937bf', '5d537c7c-8b43-415d-a02d-a16c422d8250', '38ac956a-6161-4d86-b285-064d4d0b6c33', '203dc66e-cc90-480b-b9fb-8f23a7377fc4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:46 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:46 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-0155c78b-a521-4702-b0df-e49d876bbbcd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-0155c78b-a521-4702-b0df-e49d876bbbcd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-quobyte-0155c78b-a521-4702-b0df-e49d876bbbcd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-0155c78b-a521-4702-b0df-e49d876bbbcd" acquired by "delete_volume" :: waited 0.043s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba8881-b13e-4617-8974-724fbe53b6c5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:46 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd Jul 11 18:48:46 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-c31e94ba-ce65-40ce-aa63-aceed149433a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Lock "cinder-c31e94ba-ce65-40ce-aa63-aceed149433a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-quobyte-c31e94ba-ce65-40ce-aa63-aceed149433a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Lock "cinder-quobyte-c31e94ba-ce65-40ce-aa63-aceed149433a" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:47 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.040s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Deleted volume successfully. Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a200ff40-e02e-4cd4-a685-8188068e887c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c200f49b-caeb-4f2c-9b2f-6f1a9c85c1a3 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-06847663-5768-42fb-ac5d-493845ccced2-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:47 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a Jul 11 18:48:47 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:47 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd" returned: 0 in 1.246s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:48 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd Jul 11 18:48:48 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:48 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a" returned: 0 in 1.223s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:48 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a Jul 11 18:48:48 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:49 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0155c78b-a521-4702-b0df-e49d876bbbcd" returned: 0 in 1.042s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-0155c78b-a521-4702-b0df-e49d876bbbcd" released by "delete_volume" :: held 2.358s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Created reservations ['11026bfd-9d2e-4da6-ba9d-4d7176e14d20', 'ab3229a6-6ff6-49b6-a6c6-8dc13580cd46', 'ea87f27d-052d-4455-81d5-6ec753614c57', '56e03723-3aef-4c02-8854-57881d33fcec'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:49 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:49 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:49 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c31e94ba-ce65-40ce-aa63-aceed149433a" returned: 0 in 0.798s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Lock "cinder-quobyte-c31e94ba-ce65-40ce-aa63-aceed149433a" released by "delete_volume" :: held 2.105s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Created reservations ['d0a4d479-03d9-4c32-9843-f7a617ab3bdf', 'dddbd64d-135d-449a-af14-6e47d216393c', '1a545dc7-e7d5-4511-b6cb-c9fd6eca4b4b', '646dc9de-adb2-4866-a6d9-cda48431e37d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:49 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:49 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:49 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Deleted volume successfully. Jul 11 18:48:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddd83d27-202d-44b4-9e9c-321fa198b6ed tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-0155c78b-a521-4702-b0df-e49d876bbbcd-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-0462e4bd-eea4-4bbd-ad00-2484d3379954-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-0462e4bd-eea4-4bbd-ad00-2484d3379954-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "cinder-quobyte-0462e4bd-eea4-4bbd-ad00-2484d3379954" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-0462e4bd-eea4-4bbd-ad00-2484d3379954" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[222df669-2eea-4f6b-be77-5da03bc71dd0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:50 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 Jul 11 18:48:50 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:50 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.773s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Deleted volume successfully. Jul 11 18:48:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ad6d08e-87bc-49c4-909f-57fffdc6b9b0 tempest-VolumesActionsTest-621447175 None] Lock "cinder-c31e94ba-ce65-40ce-aa63-aceed149433a-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:51 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954" returned: 0 in 0.823s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:51 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954 Jul 11 18:48:51 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (e7a7f36b-3432-49a2-92e4-2a790d6a983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39957519-7bc7-4bab-a91e-eb9868df8ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39957519-7bc7-4bab-a91e-eb9868df8ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-777278975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d2fc71-19f4-494b-98ff-98bc08246b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:51Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8185bab-c476-4b1d-8abb-9d7414ed062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8185bab-c476-4b1d-8abb-9d7414ed062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868b33c1-a6ab-41ca-b9a2-bf19f3f2c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868b33c1-a6ab-41ca-b9a2-bf19f3f2c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d2fc71-19f4-494b-98ff-98bc08246b15', 'volume_name': 'volume-22d2fc71-19f4-494b-98ff-98bc08246b15', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee63bcb8-4244-433c-b3cd-0b3f1b04215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee63bcb8-4244-433c-b3cd-0b3f1b04215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df297dba-85f2-4522-9560-f0f61b378696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Volume 22d2fc71-19f4-494b-98ff-98bc08246b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d2fc71-19f4-494b-98ff-98bc08246b15', 'volume_size': 1} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-777278975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d2fc71-19f4-494b-98ff-98bc08246b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:51Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Creating volume 22d2fc71-19f4-494b-98ff-98bc08246b15 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:51 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:51 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 1073741824 Jul 11 18:48:51 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:51 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0462e4bd-eea4-4bbd-ad00-2484d3379954" returned: 0 in 0.687s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-quobyte-0462e4bd-eea4-4bbd-ad00-2484d3379954" released by "delete_volume" :: held 1.573s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Created reservations ['7f17d814-2361-417d-b53a-e538465b57cb', '74f67a30-f5bd-417d-b776-fbbde9af2fe3', '2334bcf5-b501-4187-8271-651b7243bece', 'eb567738-3d00-4387-9c32-285972d22629'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:51 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:51 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:52 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 1073741824" returned: 0 in 0.918s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:52 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 Jul 11 18:48:52 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:52 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.679s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Deleted volume successfully. Jul 11 18:48:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fcf90c78-4f6f-4da2-89cf-db03e3c0d922 tempest-CreateVolumesFromImageTest-159923596 None] Lock "cinder-0462e4bd-eea4-4bbd-ad00-2484d3379954-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:52 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15" returned: 0 in 0.771s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df297dba-85f2-4522-9560-f0f61b378696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d2fc71-19f4-494b-98ff-98bc08246b15', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4285f6d-5abd-4d65-816b-d605fe4abbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:53 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Volume volume-22d2fc71-19f4-494b-98ff-98bc08246b15 (22d2fc71-19f4-494b-98ff-98bc08246b15): created successfully Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4285f6d-5abd-4d65-816b-d605fe4abbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (e7a7f36b-3432-49a2-92e4-2a790d6a983c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c13152e8-d96f-478d-9fa3-aac9ab38f60a tempest-VolumesActionsTest-662874814 None] Created volume successfully. Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-22d2fc71-19f4-494b-98ff-98bc08246b15-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Lock "cinder-22d2fc71-19f4-494b-98ff-98bc08246b15-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-quobyte-22d2fc71-19f4-494b-98ff-98bc08246b15" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Lock "cinder-quobyte-22d2fc71-19f4-494b-98ff-98bc08246b15" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb79aeb2-8341-49f0-afe6-2d026efcafea]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:53 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 Jul 11 18:48:53 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:54 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15" returned: 0 in 0.875s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:54 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15 Jul 11 18:48:54 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:55 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-22d2fc71-19f4-494b-98ff-98bc08246b15" returned: 0 in 0.827s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Lock "cinder-quobyte-22d2fc71-19f4-494b-98ff-98bc08246b15" released by "delete_volume" :: held 1.754s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Created reservations ['6e69fed0-b6e0-4fa2-bc55-b4403c6b7ba3', '672e784d-4c71-4af1-9e0f-376218003162', '7a79c5cf-e0a6-4e66-8852-370d1f44e4c5', '46fe22cf-b80e-432b-9db9-9caca2260407'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:55 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:48:55 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (bfb1097f-99b3-445f-a6d1-6d5b4fc6e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:56 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74c00e0-6c4b-498e-989c-2589ec8ef6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.133s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Deleted volume successfully. Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74c00e0-6c4b-498e-989c-2589ec8ef6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1154174736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e1da6c-263b-43e1-aec6-cefb173ee391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:56Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5b699f-281d-42be-a4d1-81918f9124ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5b699f-281d-42be-a4d1-81918f9124ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6360495-8191-47c2-bdde-0e5b4d604068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6360495-8191-47c2-bdde-0e5b4d604068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e1da6c-263b-43e1-aec6-cefb173ee391', 'volume_name': 'volume-a1e1da6c-263b-43e1-aec6-cefb173ee391', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a15f9a-fb99-4c06-87da-be481aecf6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a15f9a-fb99-4c06-87da-be481aecf6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8a1597-fe05-4a80-9a98-db0afc76ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Volume a1e1da6c-263b-43e1-aec6-cefb173ee391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e1da6c-263b-43e1-aec6-cefb173ee391', 'volume_size': 1} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1154174736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e1da6c-263b-43e1-aec6-cefb173ee391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:56Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Creating volume a1e1da6c-263b-43e1-aec6-cefb173ee391 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:56 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:56 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 1073741824 Jul 11 18:48:56 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0036933c-58a5-46b5-9f94-1f4007812f72 tempest-VolumesActionsTest-621447175 None] Lock "cinder-22d2fc71-19f4-494b-98ff-98bc08246b15-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:57 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 1073741824" returned: 0 in 1.010s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:57 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 Jul 11 18:48:57 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:58 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391" returned: 0 in 0.705s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8a1597-fe05-4a80-9a98-db0afc76ae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e1da6c-263b-43e1-aec6-cefb173ee391', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eecf26b-06b1-4bae-9d0b-676b36ab0954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Volume volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 (a1e1da6c-263b-43e1-aec6-cefb173ee391): created successfully Jul 11 18:48:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eecf26b-06b1-4bae-9d0b-676b36ab0954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (bfb1097f-99b3-445f-a6d1-6d5b4fc6e95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1e48f5ac-e3d1-4fd0-a554-57853f1143f6 tempest-VolumesActionsTest-662874814 None] Created volume successfully. Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=115,cinder:UPDATE=135,cinder:DELETE=13,cinder:INSERT=28 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=155,cinder:SELECT=85,cinder:INSERT=40,cinder:DELETE=11 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Flow 'volume_create_manager' (1115c331-ce81-422d-8194-0ba38ac98e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519e7394-84ee-4d2f-9c38-80e5bc7ad7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519e7394-84ee-4d2f-9c38-80e5bc7ad7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83864531-1ed9-4faf-bb66-9f0c4834f832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3c79c07784e479dd008265dfa5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:59Z,use_quota=True,user_id='fdd653d0dbdc4e30a0615405e73b7bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2825e10d-596a-4de7-9fe2-7b6e76fdceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2825e10d-596a-4de7-9fe2-7b6e76fdceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f210651-ec94-4eed-9599-78c2c919bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f210651-ec94-4eed-9599-78c2c919bd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83864531-1ed9-4faf-bb66-9f0c4834f832', 'volume_name': 'volume-83864531-1ed9-4faf-bb66-9f0c4834f832', 'volume_size': 1, 'image_id': '21d42f69-0459-49d3-81b3-3e9c4cd01847', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21d42f69-0459-49d3-81b3-3e9c4cd01847', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57a0ad448557088ab1ceebdc50b9d83e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbd3c79c07784e479dd008265dfa5cf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad27f942f6ae6272bd4b3d140c1b7767389b8e70962b764a8f6e552c70dcd543e478f4f03c0c5107b8ac64c2c5f1633244ac477bbd786db0342b0e01ebaecf7a', 'id': '21d42f69-0459-49d3-81b3-3e9c4cd01847', 'created_at': datetime.datetime(2026, 7, 11, 16, 48, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 48, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21d42f69-0459-49d3-81b3-3e9c4cd01847/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232f55b1-6154-4678-8970-e3132968d57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232f55b1-6154-4678-8970-e3132968d57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27650f3-2e87-4d06-9e5a-f55a4edf308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Volume 83864531-1ed9-4faf-bb66-9f0c4834f832: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83864531-1ed9-4faf-bb66-9f0c4834f832', 'volume_size': 1, 'image_id': '21d42f69-0459-49d3-81b3-3e9c4cd01847', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21d42f69-0459-49d3-81b3-3e9c4cd01847', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57a0ad448557088ab1ceebdc50b9d83e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbd3c79c07784e479dd008265dfa5cf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad27f942f6ae6272bd4b3d140c1b7767389b8e70962b764a8f6e552c70dcd543e478f4f03c0c5107b8ac64c2c5f1633244ac477bbd786db0342b0e01ebaecf7a', 'id': '21d42f69-0459-49d3-81b3-3e9c4cd01847', 'created_at': datetime.datetime(2026, 7, 11, 16, 48, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 48, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21d42f69-0459-49d3-81b3-3e9c4cd01847/file', 'properties': {}}, 'image_service': } Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Trying to clone 83864531-1ed9-4faf-bb66-9f0c4834f832 from image 21d42f69-0459-49d3-81b3-3e9c4cd01847 at location (None, [{'url': 'file:///opt/stack/data/glance/images/21d42f69-0459-49d3-81b3-3e9c4cd01847', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:48:59 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Image download 0.00 MB at 0.00 MB/s Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-a1e1da6c-263b-43e1-aec6-cefb173ee391-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2666431-60b7-458a-9726-a2c6ee0e2e15]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Lock "cinder-a1e1da6c-263b-43e1-aec6-cefb173ee391-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Acquiring lock "cinder-quobyte-a1e1da6c-263b-43e1-aec6-cefb173ee391" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Lock "cinder-quobyte-a1e1da6c-263b-43e1-aec6-cefb173ee391" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:59 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD Jul 11 18:48:59 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[06edc2a8-563b-4894-adc9-ea943ea52a01]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:00 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 Jul 11 18:49:00 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:00 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:00 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD Jul 11 18:49:00 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:00 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391" returned: 0 in 0.833s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:00 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391 Jul 11 18:49:00 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:01 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD" returned: 1 in 0.820s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Temporary image 21d42f69-0459-49d3-81b3-3e9c4cd01847 is fetched for user fdd653d0dbdc4e30a0615405e73b7bfc. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:49:01 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a1e1da6c-263b-43e1-aec6-cefb173ee391" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Lock "cinder-quobyte-a1e1da6c-263b-43e1-aec6-cefb173ee391" released by "delete_volume" :: held 1.678s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f497aab9-8b59-48d7-ae92-84468b594823]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Created reservations ['b12b51f2-effb-4e69-b759-33a4f29da9a7', 'ee77ff0b-70b6-430d-bd1d-694f02e130fb', '52da1b35-1dbe-4d0f-bb55-74cc9d6d2b1b', 'b9eaf394-7030-49c3-89f8-ddd47591dd08'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:01 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD Jul 11 18:49:01 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:01 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:01 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Flow 'volume_create_manager' (89fcc704-0b9f-42fd-8387-4ee141a9baac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb76a574-5509-4a73-b549-7da6f4e0ccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb76a574-5509-4a73-b549-7da6f4e0ccb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-331110692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fa070d-cd27-4cc6-86ea-95cc2f72183f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8f56fef984994873ffebb185bd100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:02Z,use_quota=True,user_id='2b62303bf5ad4ec486ad0699f61ae789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8b4735-250a-4c8c-b125-4efe57437d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8b4735-250a-4c8c-b125-4efe57437d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e3c218-8379-4291-b57c-e1fc6788444f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e3c218-8379-4291-b57c-e1fc6788444f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43fa070d-cd27-4cc6-86ea-95cc2f72183f', 'volume_name': 'volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cb48b9-b021-4d6f-8bb4-e3fb3126a2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cb48b9-b021-4d6f-8bb4-e3fb3126a2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b5ae0e-2b50-4f77-8f2a-86760035cf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Volume 43fa070d-cd27-4cc6-86ea-95cc2f72183f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f', 'volume_size': 1} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-331110692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fa070d-cd27-4cc6-86ea-95cc2f72183f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8f56fef984994873ffebb185bd100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:02Z,use_quota=True,user_id='2b62303bf5ad4ec486ad0699f61ae789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Creating volume 43fa070d-cd27-4cc6-86ea-95cc2f72183f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:02 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:02 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f 1073741824 Jul 11 18:49:02 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:02 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.983s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Deleted volume successfully. Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cd7ed90-fdd2-4b89-9bbc-9aa087b33c0f tempest-VolumesActionsTest-621447175 None] Lock "cinder-a1e1da6c-263b-43e1-aec6-cefb173ee391-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:02 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD" returned: 0 in 1.253s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:03 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD Jul 11 18:49:03 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (bc6cd1de-4617-429b-8938-951dd44cceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89079327-a7f3-4693-986b-549dbaa22cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89079327-a7f3-4693-986b-549dbaa22cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1017723911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014a4146-f3ff-4cda-a42e-246f7f4d7677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:03Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3f047f-039b-477a-9d19-da456945317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3f047f-039b-477a-9d19-da456945317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bf49c8-a896-4b1e-a6d2-158b1f59e219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bf49c8-a896-4b1e-a6d2-158b1f59e219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '014a4146-f3ff-4cda-a42e-246f7f4d7677', 'volume_name': 'volume-014a4146-f3ff-4cda-a42e-246f7f4d7677', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d31658-fee2-4e17-9ffe-17715b39ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d31658-fee2-4e17-9ffe-17715b39ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4c9460-b3eb-40da-9caf-ec742f8ac7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Volume 014a4146-f3ff-4cda-a42e-246f7f4d7677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-014a4146-f3ff-4cda-a42e-246f7f4d7677', 'volume_size': 1} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:03 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f 1073741824" returned: 0 in 1.105s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:03 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f Jul 11 18:49:03 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:03 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD" returned: 1 in 0.848s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:49:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:04 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f" returned: 0 in 0.823s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1017723911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014a4146-f3ff-4cda-a42e-246f7f4d7677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda5524f734642c491bb540e3bd4b3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:03Z,use_quota=True,user_id='01795f434b82488da8deab12069983f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Creating volume 014a4146-f3ff-4cda-a42e-246f7f4d7677 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:04 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 1073741824 Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b5ae0e-2b50-4f77-8f2a-86760035cf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:04 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0876f4-1fd1-480a-a904-1d1c30f5e671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Volume volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f (43fa070d-cd27-4cc6-86ea-95cc2f72183f): created successfully Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0876f4-1fd1-480a-a904-1d1c30f5e671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Flow 'volume_create_manager' (89fcc704-0b9f-42fd-8387-4ee141a9baac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-69c63d67-bab3-4e6c-b4e0-8c311fec67dd tempest-AttachVolumeTestJSON-1769326654 None] Created volume successfully. Jul 11 18:49:05 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 1073741824" returned: 0 in 0.985s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:05 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 Jul 11 18:49:05 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:06 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677" returned: 0 in 0.699s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.302s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83864531-1ed9-4faf-bb66-9f0c4834f832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3c79c07784e479dd008265dfa5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:59Z,use_quota=True,user_id='fdd653d0dbdc4e30a0615405e73b7bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Creating volume 83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:06 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:06 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 1073741824 Jul 11 18:49:06 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4c9460-b3eb-40da-9caf-ec742f8ac7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014a4146-f3ff-4cda-a42e-246f7f4d7677', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d9ccdd-bf54-4ee5-8386-66048278b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Volume volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 (014a4146-f3ff-4cda-a42e-246f7f4d7677): created successfully Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d9ccdd-bf54-4ee5-8386-66048278b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Flow 'volume_create_manager' (bc6cd1de-4617-429b-8938-951dd44cceb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8f875839-7306-4182-87b8-83348d6ca213 tempest-VolumesActionsTest-662874814 None] Created volume successfully. Jul 11 18:49:07 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 1073741824" returned: 0 in 1.008s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:07 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 Jul 11 18:49:07 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Acquiring lock "cinder-014a4146-f3ff-4cda-a42e-246f7f4d7677-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Lock "cinder-014a4146-f3ff-4cda-a42e-246f7f4d7677-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Acquiring lock "cinder-quobyte-014a4146-f3ff-4cda-a42e-246f7f4d7677" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Lock "cinder-quobyte-014a4146-f3ff-4cda-a42e-246f7f4d7677" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[73491ad0-fcb3-455e-ab25-24fb3cce8d66]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:07 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 Jul 11 18:49:07 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:07 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832" returned: 0 in 0.770s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Attempting download of 21d42f69-0459-49d3-81b3-3e9c4cd01847 ((None, [{'url': 'file:///opt/stack/data/glance/images/21d42f69-0459-49d3-81b3-3e9c4cd01847', 'metadata': {}}])) to volume 83864531-1ed9-4faf-bb66-9f0c4834f832. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a87476-ae5c-4559-b2e9-3945e933111a]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21d42f69-0459-49d3-81b3-3e9c4cd01847_zg95318w {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:08 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21d42f69-0459-49d3-81b3-3e9c4cd01847_zg95318w Jul 11 18:49:08 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:08 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677" returned: 0 in 0.948s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:08 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677 Jul 11 18:49:08 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-9860da41-3533-49bc-a6a4-75238a0afcb0 req-338136ba-ef67-4cf9-8992-d2770fc47ca1 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-9860da41-3533-49bc-a6a4-75238a0afcb0 req-338136ba-ef67-4cf9-8992-d2770fc47ca1 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:09 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21d42f69-0459-49d3-81b3-3e9c4cd01847_zg95318w" returned: 0 in 1.095s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21d42f69-0459-49d3-81b3-3e9c4cd01847_zg95318w {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed2f64-db7b-4ba1-b630-7ae78f41f814]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-9860da41-3533-49bc-a6a4-75238a0afcb0 req-338136ba-ef67-4cf9-8992-d2770fc47ca1 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:09 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21d42f69-0459-49d3-81b3-3e9c4cd01847_zg95318w Jul 11 18:49:09 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:09 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014a4146-f3ff-4cda-a42e-246f7f4d7677" returned: 0 in 0.996s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:09 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f Jul 11 18:49:09 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Lock "cinder-quobyte-014a4146-f3ff-4cda-a42e-246f7f4d7677" released by "delete_volume" :: held 2.008s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Created reservations ['30a41e3d-006e-42a3-a9a1-dca97e0c383f', 'f045a302-654a-40fd-b700-2daff24f7278', '475e0946-7f33-4fd4-9717-61843cbd1105', 'aaece812-7223-44d7-b412-89a18e8bcc4f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:09 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:09 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:10 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21d42f69-0459-49d3-81b3-3e9c4cd01847_zg95318w" returned: 1 in 1.082s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21d42f69-0459-49d3-81b3-3e9c4cd01847_zg95318w' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6d8dce-aa36-4542-8384-0b22438bdfcf]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:10 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD Jul 11 18:49:10 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:10 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-9860da41-3533-49bc-a6a4-75238a0afcb0 req-338136ba-ef67-4cf9-8992-d2770fc47ca1 tempest-AttachVolumeTestJSON-1769326654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f" returned: 0 in 1.260s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-9860da41-3533-49bc-a6a4-75238a0afcb0 req-338136ba-ef67-4cf9-8992-d2770fc47ca1 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.302s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-9860da41-3533-49bc-a6a4-75238a0afcb0 req-338136ba-ef67-4cf9-8992-d2770fc47ca1 tempest-AttachVolumeTestJSON-1769326654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e2c0aec-ebda-4fd7-a2d9-73e8f1ef40e6', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:49:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-9860da41-3533-49bc-a6a4-75238a0afcb0 req-338136ba-ef67-4cf9-8992-d2770fc47ca1 tempest-AttachVolumeTestJSON-1769326654 None] attachment_update completed successfully. Jul 11 18:49:10 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Deleted volume successfully. Jul 11 18:49:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c3595d0-719d-4c16-8cb6-5f6759f0508b tempest-VolumesActionsTest-662874814 None] Lock "cinder-014a4146-f3ff-4cda-a42e-246f7f4d7677-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:11 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD" returned: 0 in 0.988s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:11 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD Jul 11 18:49:11 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:12 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD" returned: 1 in 0.880s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:49:12 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] 21d42f69-0459-49d3-81b3-3e9c4cd01847 was raw, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:49:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:12 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 Jul 11 18:49:12 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:12 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832" returned: 0 in 0.818s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:12 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21d42f69-0459-49d3-81b3-3e9c4cd01847_3h489y_qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:49:12 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 18:49:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:12 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 1G Jul 11 18:49:12 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:13 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 1G" returned: 0 in 0.760s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d368d018-4266-464a-9296-8dd3035b1323]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:13 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 Jul 11 18:49:13 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:14 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832" returned: 0 in 0.968s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:14 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 Jul 11 18:49:14 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:15 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:15 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:15 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832" returned: 1 in 1.131s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Downloaded image 21d42f69-0459-49d3-81b3-3e9c4cd01847 ((None, [{'url': 'file:///opt/stack/data/glance/images/21d42f69-0459-49d3-81b3-3e9c4cd01847', 'metadata': {}}])) to volume 83864531-1ed9-4faf-bb66-9f0c4834f832 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Temporary image 21d42f69-0459-49d3-81b3-3e9c4cd01847 for user fdd653d0dbdc4e30a0615405e73b7bfc is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Marking volume 83864531-1ed9-4faf-bb66-9f0c4834f832 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Copying metadata from image 21d42f69-0459-49d3-81b3-3e9c4cd01847 to 83864531-1ed9-4faf-bb66-9f0c4834f832. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Creating volume glance metadata for volume 83864531-1ed9-4faf-bb66-9f0c4834f832 backed by image 21d42f69-0459-49d3-81b3-3e9c4cd01847 with: {'image_id': '21d42f69-0459-49d3-81b3-3e9c4cd01847', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '57a0ad448557088ab1ceebdc50b9d83e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27650f3-2e87-4d06-9e5a-f55a4edf308d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83864531-1ed9-4faf-bb66-9f0c4834f832', 'volume_size': 1, 'image_id': '21d42f69-0459-49d3-81b3-3e9c4cd01847', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21d42f69-0459-49d3-81b3-3e9c4cd01847', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57a0ad448557088ab1ceebdc50b9d83e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbd3c79c07784e479dd008265dfa5cf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad27f942f6ae6272bd4b3d140c1b7767389b8e70962b764a8f6e552c70dcd543e478f4f03c0c5107b8ac64c2c5f1633244ac477bbd786db0342b0e01ebaecf7a', 'id': '21d42f69-0459-49d3-81b3-3e9c4cd01847', 'created_at': datetime.datetime(2026, 7, 11, 16, 48, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 48, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21d42f69-0459-49d3-81b3-3e9c4cd01847/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e582702b-d40d-4b44-80a0-db15f44b60fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Volume volume-83864531-1ed9-4faf-bb66-9f0c4834f832 (83864531-1ed9-4faf-bb66-9f0c4834f832): created successfully Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e582702b-d40d-4b44-80a0-db15f44b60fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Flow 'volume_create_manager' (1115c331-ce81-422d-8194-0ba38ac98e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c5566809-64e3-4703-8147-f67d4c73ac8b tempest-VolumeImageDependencyTests-1445464956 None] Created volume successfully. Jul 11 18:49:16 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.136s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Flow 'volume_create_manager' (40d76154-b823-4991-b853-01b32acf728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68893f8-c5a9-4803-b5c0-492d089c168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68893f8-c5a9-4803-b5c0-492d089c168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-219571200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f3c84b-da41-4ea3-8ede-741b84204167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8f56fef984994873ffebb185bd100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:16Z,use_quota=True,user_id='2b62303bf5ad4ec486ad0699f61ae789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f45b0ac-7109-43ce-9df9-de3117295827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f45b0ac-7109-43ce-9df9-de3117295827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c77a9b-9cdb-4fba-93e4-7293a1ef2566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c77a9b-9cdb-4fba-93e4-7293a1ef2566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f3c84b-da41-4ea3-8ede-741b84204167', 'volume_name': 'volume-36f3c84b-da41-4ea3-8ede-741b84204167', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b1e476-1c91-4cba-8377-9e8b38e397d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b1e476-1c91-4cba-8377-9e8b38e397d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984c3350-7e3f-4f9d-9803-7a5e9bf33e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Volume 36f3c84b-da41-4ea3-8ede-741b84204167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f3c84b-da41-4ea3-8ede-741b84204167', 'volume_size': 1} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-219571200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f3c84b-da41-4ea3-8ede-741b84204167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8f56fef984994873ffebb185bd100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:16Z,use_quota=True,user_id='2b62303bf5ad4ec486ad0699f61ae789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Creating volume 36f3c84b-da41-4ea3-8ede-741b84204167 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:16 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:16 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 1073741824 Jul 11 18:49:16 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Acquiring lock "cinder-83864531-1ed9-4faf-bb66-9f0c4834f832-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Lock "cinder-83864531-1ed9-4faf-bb66-9f0c4834f832-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Acquiring lock "cinder-quobyte-83864531-1ed9-4faf-bb66-9f0c4834f832" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Lock "cinder-quobyte-83864531-1ed9-4faf-bb66-9f0c4834f832" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1babf336-d0d6-482c-b015-f9c838898912]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:17 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 Jul 11 18:49:17 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:17 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 1073741824" returned: 0 in 1.201s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:17 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 Jul 11 18:49:17 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:18 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832" returned: 0 in 1.101s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:18 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 Jul 11 18:49:18 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:18 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167" returned: 0 in 0.895s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984c3350-7e3f-4f9d-9803-7a5e9bf33e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f3c84b-da41-4ea3-8ede-741b84204167', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90e5d03-892e-4c18-815d-c99ae13462ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Volume volume-36f3c84b-da41-4ea3-8ede-741b84204167 (36f3c84b-da41-4ea3-8ede-741b84204167): created successfully Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90e5d03-892e-4c18-815d-c99ae13462ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Flow 'volume_create_manager' (40d76154-b823-4991-b853-01b32acf728a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c7fede76-5f6c-4813-93a2-6b6f9baf7044 tempest-AttachVolumeTestJSON-1769326654 None] Created volume successfully. Jul 11 18:49:19 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832" returned: 1 in 1.085s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:49:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:19 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832 Jul 11 18:49:19 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:19 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-83864531-1ed9-4faf-bb66-9f0c4834f832" returned: 0 in 0.797s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Lock "cinder-quobyte-83864531-1ed9-4faf-bb66-9f0c4834f832" released by "delete_volume" :: held 3.069s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Created reservations ['442aa02b-6361-4806-92f1-ed703db0906d', 'b378f7b5-57f3-4199-8257-d658d3b86dbb', '257737c0-45b7-40f9-8d71-42b20b5a9474', '7fa87c50-230d-4cb9-a1cc-7de99797227a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:20 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:20 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:21 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.042s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:21 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Deleted volume successfully. Jul 11 18:49:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dfb51810-81d7-4b93-b063-ee7c8a7c15a3 tempest-VolumeImageDependencyTests-1445464956 None] Lock "cinder-83864531-1ed9-4faf-bb66-9f0c4834f832-delete_volume" released by "delete_volume" :: held 4.454s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-f6d336fb-2911-41ba-bb82-2929a36d76ee req-37a0a167-75f3-4537-b297-c4c10353e3ec tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-f6d336fb-2911-41ba-bb82-2929a36d76ee req-37a0a167-75f3-4537-b297-c4c10353e3ec tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c3f206-0690-4175-a6b8-cd7be2116e72]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-f6d336fb-2911-41ba-bb82-2929a36d76ee req-37a0a167-75f3-4537-b297-c4c10353e3ec tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:23 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 Jul 11 18:49:23 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:24 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-f6d336fb-2911-41ba-bb82-2929a36d76ee req-37a0a167-75f3-4537-b297-c4c10353e3ec tempest-AttachVolumeTestJSON-1769326654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167" returned: 0 in 1.141s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-f6d336fb-2911-41ba-bb82-2929a36d76ee req-37a0a167-75f3-4537-b297-c4c10353e3ec tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.166s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-f6d336fb-2911-41ba-bb82-2929a36d76ee req-37a0a167-75f3-4537-b297-c4c10353e3ec tempest-AttachVolumeTestJSON-1769326654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-36f3c84b-da41-4ea3-8ede-741b84204167', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40f00f7e-c212-49b4-ba1d-35fc522c817a', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:49:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-f6d336fb-2911-41ba-bb82-2929a36d76ee req-37a0a167-75f3-4537-b297-c4c10353e3ec tempest-AttachVolumeTestJSON-1769326654 None] attachment_update completed successfully. Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Flow 'volume_create_manager' (daa7eda0-6c5a-4e03-8695-7ae59a60a08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588f7c56-8b23-4464-852e-cb693a7af95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588f7c56-8b23-4464-852e-cb693a7af95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1888671974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6074d9698c1424cbbfde39c29e4dc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:27Z,use_quota=True,user_id='505aad61fbac4f21b04326ca7db181ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7569304a-327e-4c28-8309-4766566db863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7569304a-327e-4c28-8309-4766566db863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c228a929-2175-4ed0-bd34-885bcb328e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c228a929-2175-4ed0-bd34-885bcb328e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6', 'volume_name': 'volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaa3106-7483-4c5e-b0a1-7de8a58946d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaa3106-7483-4c5e-b0a1-7de8a58946d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8d3f0-bc70-45b6-a1f8-a2c7ff6bbbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:27 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Volume 66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6', 'volume_size': 1} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1888671974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6074d9698c1424cbbfde39c29e4dc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:27Z,use_quota=True,user_id='505aad61fbac4f21b04326ca7db181ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Creating volume 66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:27 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:27 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 1073741824 Jul 11 18:49:27 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:28 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 1073741824" returned: 0 in 0.997s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:28 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 Jul 11 18:49:28 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:29 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8d3f0-bc70-45b6-a1f8-a2c7ff6bbbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fb586f-1f6e-4801-830b-74efe58f5c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Volume volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 (66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6): created successfully Jul 11 18:49:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fb586f-1f6e-4801-830b-74efe58f5c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Flow 'volume_create_manager' (daa7eda0-6c5a-4e03-8695-7ae59a60a08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6ac28bfd-e91d-4205-964c-b16496403fa9 tempest-VolumesListAdminTestJSON-1413801074 None] Created volume successfully. Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Flow 'volume_create_manager' (d4b4674f-2ab5-4956-8c8c-4413e54039c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8c828c-e6eb-4e85-a045-8fe7c00803da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8c828c-e6eb-4e85-a045-8fe7c00803da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1128561882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9169cd85-ce20-4cb8-839a-248d1059abc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6074d9698c1424cbbfde39c29e4dc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:31Z,use_quota=True,user_id='505aad61fbac4f21b04326ca7db181ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa1e775-4a97-4fef-94db-24212c86124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa1e775-4a97-4fef-94db-24212c86124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51e83dc-fffd-440f-8464-f10649db8b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51e83dc-fffd-440f-8464-f10649db8b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9169cd85-ce20-4cb8-839a-248d1059abc8', 'volume_name': 'volume-9169cd85-ce20-4cb8-839a-248d1059abc8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0c724a-6a5a-46d7-ae70-d7cceb6a25e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0c724a-6a5a-46d7-ae70-d7cceb6a25e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091c62ab-d020-4af9-ae4a-93856b15cef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:30 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Volume 9169cd85-ce20-4cb8-839a-248d1059abc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9169cd85-ce20-4cb8-839a-248d1059abc8', 'volume_size': 1} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1128561882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9169cd85-ce20-4cb8-839a-248d1059abc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6074d9698c1424cbbfde39c29e4dc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:31Z,use_quota=True,user_id='505aad61fbac4f21b04326ca7db181ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Creating volume 9169cd85-ce20-4cb8-839a-248d1059abc8 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:31 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 1073741824 Jul 11 18:49:31 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-d0ca91fa-736d-4709-8e8c-8cd117dc5388 req-09dd7d7d-8dd8-461b-8c4b-eb999eed020e tempest-AttachVolumeTestJSON-1769326654 None] Terminate volume connection completed successfully. Jul 11 18:49:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-d0ca91fa-736d-4709-8e8c-8cd117dc5388 req-09dd7d7d-8dd8-461b-8c4b-eb999eed020e tempest-AttachVolumeTestJSON-1769326654 None] Deleting attachment 9e2c0aec-ebda-4fd7-a2d9-73e8f1ef40e6. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:49:32 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 1073741824" returned: 0 in 1.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:32 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 Jul 11 18:49:32 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:32 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8" returned: 0 in 0.749s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091c62ab-d020-4af9-ae4a-93856b15cef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9169cd85-ce20-4cb8-839a-248d1059abc8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6fb580-9f05-4ed4-a4d4-50614becc4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Volume volume-9169cd85-ce20-4cb8-839a-248d1059abc8 (9169cd85-ce20-4cb8-839a-248d1059abc8): created successfully Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6fb580-9f05-4ed4-a4d4-50614becc4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Flow 'volume_create_manager' (d4b4674f-2ab5-4956-8c8c-4413e54039c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9e056068-1035-47f4-a018-dd77150e4427 tempest-VolumesListAdminTestJSON-1413801074 None] Created volume successfully. Jul 11 18:49:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-3d9061fa-90b3-47f9-9736-3532f519acb1 req-c210d67e-5f1e-4dc2-97ed-6077b84e3ef9 tempest-AttachVolumeTestJSON-1769326654 None] Terminate volume connection completed successfully. Jul 11 18:49:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-3d9061fa-90b3-47f9-9736-3532f519acb1 req-c210d67e-5f1e-4dc2-97ed-6077b84e3ef9 tempest-AttachVolumeTestJSON-1769326654 None] Deleting attachment 40f00f7e-c212-49b4-ba1d-35fc522c817a. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Flow 'volume_create_manager' (8b1cb74a-a640-4e03-91fb-a3f224116056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e0ffac-c4ca-4c9a-99cf-6302260172f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e0ffac-c4ca-4c9a-99cf-6302260172f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-56817435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef26d3e-e7a4-44a6-92ed-afc04c5f6727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6074d9698c1424cbbfde39c29e4dc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:35Z,use_quota=True,user_id='505aad61fbac4f21b04326ca7db181ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f23304-3f7c-4675-b15f-63267f5989d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f23304-3f7c-4675-b15f-63267f5989d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4026760e-1078-4daf-9796-f2a17e271346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4026760e-1078-4daf-9796-f2a17e271346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef26d3e-e7a4-44a6-92ed-afc04c5f6727', 'volume_name': 'volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341dd41e-fb9d-4260-947e-3f2b6ba78bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341dd41e-fb9d-4260-947e-3f2b6ba78bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d07092f-f2eb-4448-b328-b25685a5da9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Volume 9ef26d3e-e7a4-44a6-92ed-afc04c5f6727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727', 'volume_size': 1} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-56817435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef26d3e-e7a4-44a6-92ed-afc04c5f6727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6074d9698c1424cbbfde39c29e4dc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:35Z,use_quota=True,user_id='505aad61fbac4f21b04326ca7db181ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Creating volume 9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:34 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:34 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 1073741824 Jul 11 18:49:34 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:36 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 1073741824" returned: 0 in 1.292s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:36 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 Jul 11 18:49:36 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:37 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727" returned: 0 in 0.863s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d07092f-f2eb-4448-b328-b25685a5da9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4005bdf6-571a-422a-81b7-5d9f7f67d434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:37 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Volume volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 (9ef26d3e-e7a4-44a6-92ed-afc04c5f6727): created successfully Jul 11 18:49:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4005bdf6-571a-422a-81b7-5d9f7f67d434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Flow 'volume_create_manager' (8b1cb74a-a640-4e03-91fb-a3f224116056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-98bbcdc7-f19b-41e7-83ca-4d79f051b617 tempest-VolumesListAdminTestJSON-1413801074 None] Created volume successfully. Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Flow 'volume_create_manager' (5fc207a4-3add-4a9c-8655-827e1af64310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042cde05-7ac3-48d4-8628-f3e8f5489adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042cde05-7ac3-48d4-8628-f3e8f5489adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00f81b2-8322-48c8-839a-0a80de88f53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87af6950758b41cfabb425e354759e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:39Z,use_quota=True,user_id='5405d7e55fe94354b20985ebeaf5e84c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77200ec7-6636-47e0-ae55-8ad5fcbd7e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77200ec7-6636-47e0-ae55-8ad5fcbd7e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdcb50e-8af3-4a36-a179-22d1bd3cbdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdcb50e-8af3-4a36-a179-22d1bd3cbdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00f81b2-8322-48c8-839a-0a80de88f53d', 'volume_name': 'volume-a00f81b2-8322-48c8-839a-0a80de88f53d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db92ab2a-d9de-44f7-9168-78bff9ca5f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db92ab2a-d9de-44f7-9168-78bff9ca5f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06ed748-e94c-4fc9-9b99-a60733676489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:39 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Volume a00f81b2-8322-48c8-839a-0a80de88f53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00f81b2-8322-48c8-839a-0a80de88f53d', 'volume_size': 1} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00f81b2-8322-48c8-839a-0a80de88f53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87af6950758b41cfabb425e354759e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:39Z,use_quota=True,user_id='5405d7e55fe94354b20985ebeaf5e84c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Creating volume a00f81b2-8322-48c8-839a-0a80de88f53d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:39 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:39 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d 1073741824 Jul 11 18:49:39 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:40 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d 1073741824" returned: 0 in 1.080s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:40 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d Jul 11 18:49:40 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:41 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d" returned: 0 in 1.025s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06ed748-e94c-4fc9-9b99-a60733676489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00f81b2-8322-48c8-839a-0a80de88f53d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1dc747-6588-4309-9ab8-69bce322915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Volume volume-a00f81b2-8322-48c8-839a-0a80de88f53d (a00f81b2-8322-48c8-839a-0a80de88f53d): created successfully Jul 11 18:49:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1dc747-6588-4309-9ab8-69bce322915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Flow 'volume_create_manager' (5fc207a4-3add-4a9c-8655-827e1af64310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-424bd826-4a35-4ac0-9ff7-127f5e284da4 tempest-VolumesListAdminTestJSON-529562013 None] Created volume successfully. Jul 11 18:49:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Acquiring lock "cinder-a00f81b2-8322-48c8-839a-0a80de88f53d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Lock "cinder-a00f81b2-8322-48c8-839a-0a80de88f53d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Acquiring lock "cinder-quobyte-a00f81b2-8322-48c8-839a-0a80de88f53d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Lock "cinder-quobyte-a00f81b2-8322-48c8-839a-0a80de88f53d" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9646b913-bca7-4813-a421-a3ccc755939c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "cinder-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "cinder-quobyte-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-quobyte-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:43 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d Jul 11 18:49:43 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990764f-58c9-4fe3-8731-27a70a3ea20f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:43 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 Jul 11 18:49:43 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:44 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d" returned: 0 in 1.307s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:44 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d Jul 11 18:49:44 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:44 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727" returned: 0 in 1.348s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:44 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727 Jul 11 18:49:44 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:45 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a00f81b2-8322-48c8-839a-0a80de88f53d" returned: 0 in 0.872s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Lock "cinder-quobyte-a00f81b2-8322-48c8-839a-0a80de88f53d" released by "delete_volume" :: held 2.255s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Created reservations ['5a15e253-fbda-4c7a-ad73-5f1d5edf89cd', '74ef2180-3245-4b33-8f2a-6a4ef0f109d5', '2094c7df-3063-4c2d-b7bb-e49380b49594', 'b8136404-2861-47dc-9f26-7f9d4dde3a17'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:45 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:45 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:45 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727" returned: 0 in 1.191s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-quobyte-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727" released by "delete_volume" :: held 2.634s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Created reservations ['b869e32f-43ea-4663-8cdb-1018345e729d', '5649db2f-a5e9-4eaa-9557-c13babe06c5b', '1c7e0c55-484d-482b-9db3-cff052184d94', 'b44a8d26-d09f-490f-b5dd-414e89a59bd3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:46 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:46 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "cinder-9169cd85-ce20-4cb8-839a-248d1059abc8-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-9169cd85-ce20-4cb8-839a-248d1059abc8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "cinder-quobyte-9169cd85-ce20-4cb8-839a-248d1059abc8" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-quobyte-9169cd85-ce20-4cb8-839a-248d1059abc8" acquired by "delete_volume" :: waited 0.050s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:46 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.381s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Deleted volume successfully. Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5dcd07-71d6-4f06-bb9f-61c054af6b5e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8134517e-8c7b-42db-ad16-7570d0997594 tempest-VolumesListAdminTestJSON-529562013 None] Lock "cinder-a00f81b2-8322-48c8-839a-0a80de88f53d-delete_volume" released by "delete_volume" :: held 4.224s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:47 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 Jul 11 18:49:47 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "cinder-36f3c84b-da41-4ea3-8ede-741b84204167-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-36f3c84b-da41-4ea3-8ede-741b84204167-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "cinder-quobyte-36f3c84b-da41-4ea3-8ede-741b84204167" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-quobyte-36f3c84b-da41-4ea3-8ede-741b84204167" acquired by "delete_volume" :: waited 0.052s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cde768-b06d-48cf-8084-5a40a24ec914]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:47 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 Jul 11 18:49:47 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:48 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 2.177s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:48 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Deleted volume successfully. Jul 11 18:49:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-824197e5-e154-4df5-8fe9-86db01daaa37 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-9ef26d3e-e7a4-44a6-92ed-afc04c5f6727-delete_volume" released by "delete_volume" :: held 5.344s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:48 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8" returned: 0 in 1.605s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:48 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8 Jul 11 18:49:48 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:48 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167" returned: 0 in 1.137s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:48 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167 Jul 11 18:49:48 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:49 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9169cd85-ce20-4cb8-839a-248d1059abc8" returned: 0 in 1.216s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-quobyte-9169cd85-ce20-4cb8-839a-248d1059abc8" released by "delete_volume" :: held 3.004s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Created reservations ['28792897-1670-43c8-ac1a-b6a631596642', 'a7b8ec07-ad3e-4fce-b630-82ff4d18fccb', 'b6d46290-12fe-408c-ac47-1edcc3ad897f', '25cd94e7-4303-4cf4-a07f-fd032572ccc7'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:50 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-36f3c84b-da41-4ea3-8ede-741b84204167" returned: 0 in 1.099s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-quobyte-36f3c84b-da41-4ea3-8ede-741b84204167" released by "delete_volume" :: held 2.370s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:50 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:50 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Created reservations ['bef42c18-4c75-446e-a975-066842021155', '36f21cdd-aef8-46a8-a849-15823bff2798', 'dc38c621-ecfc-48b9-a4db-a3eb17b19a48', 'dcaee3ba-759a-45f3-a5af-2d509604d5b5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "cinder-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "cinder-quobyte-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-quobyte-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6" acquired by "delete_volume" :: waited 0.062s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:50 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:50 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[61102f0d-9f68-4782-b573-8184df69791e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:50 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 Jul 11 18:49:50 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "cinder-43fa070d-cd27-4cc6-86ea-95cc2f72183f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-43fa070d-cd27-4cc6-86ea-95cc2f72183f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "cinder-quobyte-43fa070d-cd27-4cc6-86ea-95cc2f72183f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-quobyte-43fa070d-cd27-4cc6-86ea-95cc2f72183f" acquired by "delete_volume" :: waited 0.043s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[559c2435-dbc5-489d-ae03-d15ac0670b2a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:51 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f Jul 11 18:49:51 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:51 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6" returned: 0 in 1.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:51 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6 Jul 11 18:49:51 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:52 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.861s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Deleted volume successfully. Jul 11 18:49:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32414b7e-4dfb-4469-9014-9218c407d2e5 tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-36f3c84b-da41-4ea3-8ede-741b84204167-delete_volume" released by "delete_volume" :: held 4.878s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:52 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 2.309s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Deleted volume successfully. Jul 11 18:49:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6ba2b50-a64d-472b-8d6d-b081bd6a510a tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-9169cd85-ce20-4cb8-839a-248d1059abc8-delete_volume" released by "delete_volume" :: held 5.858s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:53 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6" returned: 0 in 1.139s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-quobyte-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6" released by "delete_volume" :: held 2.627s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Created reservations ['77a0d176-cb72-4b1b-aefb-5e0ffc2b7a62', '58906c18-2f43-41a5-af80-825873753e2e', 'f5b9b7fb-7b65-4373-be61-0d40ef34ec4d', '4d5c76a2-e10e-4e60-891d-c4ceead84b44'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:53 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f" returned: 0 in 1.952s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:53 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f Jul 11 18:49:53 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:53 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:53 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:54 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.259s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:54 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Deleted volume successfully. Jul 11 18:49:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe019097-ae47-4e00-865b-91d3c995a865 tempest-VolumesListAdminTestJSON-1413801074 None] Lock "cinder-66c3d4e0-a0e9-41e0-ad11-c8fdc5f2c6b6-delete_volume" released by "delete_volume" :: held 4.430s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:54 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-43fa070d-cd27-4cc6-86ea-95cc2f72183f" returned: 0 in 1.462s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-quobyte-43fa070d-cd27-4cc6-86ea-95cc2f72183f" released by "delete_volume" :: held 3.491s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:54 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Created reservations ['defffe6d-4cd5-4f38-969f-6360f5c6f497', 'df35b73b-d219-4c9a-893d-c4c78df45e2a', '402e4b67-f0f2-493c-84e0-62f7c0909bd3', '60e7575e-ba51-457d-9923-43be4b6940c0'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:55 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:55 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "cinder-07877359-1c28-41d0-bace-52f8f8c9d81b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-07877359-1c28-41d0-bace-52f8f8c9d81b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "cinder-quobyte-07877359-1c28-41d0-bace-52f8f8c9d81b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-quobyte-07877359-1c28-41d0-bace-52f8f8c9d81b" acquired by "delete_volume" :: waited 0.040s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[809dd9df-9120-4b79-a6f4-61f2f7ad6672]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:56 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.386s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Deleted volume successfully. Jul 11 18:49:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-49654cde-6d6f-465b-ba9d-f2cd5c139aeb tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-43fa070d-cd27-4cc6-86ea-95cc2f72183f-delete_volume" released by "delete_volume" :: held 5.353s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:56 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b Jul 11 18:49:56 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:57 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b" returned: 0 in 1.212s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:57 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b Jul 11 18:49:57 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:58 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-07877359-1c28-41d0-bace-52f8f8c9d81b" returned: 0 in 1.001s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-quobyte-07877359-1c28-41d0-bace-52f8f8c9d81b" released by "delete_volume" :: held 2.274s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Created reservations ['6c63e1f1-df24-4452-a19e-37da60438018', '57edb0ba-12a9-4fe7-bd32-e132ce507c0a', 'b1c4b830-6ccc-42e1-9a96-6c78db92cac2', '0af22eff-e33e-4407-a028-345021d02d4c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:58 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:49:58 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=81,cinder:INSERT=31,cinder:UPDATE=114,cinder:DELETE=10 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:49:59 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.761s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=104,cinder:SELECT=89,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:49:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Deleted volume successfully. Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Flow 'volume_create_manager' (2cfc7571-fa20-4d68-a910-6be0796c32c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3d2d4a-bffe-4209-b52b-ee349a413c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3d2d4a-bffe-4209-b52b-ee349a413c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2025169001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce19ee6-753d-422b-b96b-86669504a09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc92b7f92e54271b83fb26d09065705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:59Z,use_quota=True,user_id='1ef12719db25420caa362c3d466f90bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b22094c-b9ca-47ef-80b8-429c81ccc872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b22094c-b9ca-47ef-80b8-429c81ccc872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbb0277-4fae-47ac-bab2-8cf73c4ea2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbb0277-4fae-47ac-bab2-8cf73c4ea2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce19ee6-753d-422b-b96b-86669504a09e', 'volume_name': 'volume-bce19ee6-753d-422b-b96b-86669504a09e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fdcbf1-ec58-4673-b428-21a1ec4834eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fdcbf1-ec58-4673-b428-21a1ec4834eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844718f3-4c38-4899-a0bc-a5bd068f4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Volume bce19ee6-753d-422b-b96b-86669504a09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce19ee6-753d-422b-b96b-86669504a09e', 'volume_size': 1} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2025169001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce19ee6-753d-422b-b96b-86669504a09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc92b7f92e54271b83fb26d09065705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:59Z,use_quota=True,user_id='1ef12719db25420caa362c3d466f90bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Creating volume bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:59 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b271d1a4-2cac-4362-9fb9-4199f25af46e tempest-AttachVolumeTestJSON-1769326654 None] Lock "cinder-07877359-1c28-41d0-bace-52f8f8c9d81b-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:59 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e 1073741824 Jul 11 18:49:59 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:00 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e 1073741824" returned: 0 in 0.969s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:00 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e Jul 11 18:50:00 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:01 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e" returned: 0 in 0.800s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844718f3-4c38-4899-a0bc-a5bd068f4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce19ee6-753d-422b-b96b-86669504a09e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87310a3e-0f79-4bdb-a8a3-d4ceea68c058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Volume volume-bce19ee6-753d-422b-b96b-86669504a09e (bce19ee6-753d-422b-b96b-86669504a09e): created successfully Jul 11 18:50:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87310a3e-0f79-4bdb-a8a3-d4ceea68c058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Flow 'volume_create_manager' (2cfc7571-fa20-4d68-a910-6be0796c32c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ec7d6450-5ab9-4a9a-bf5d-15b282e452a0 tempest-SnapshotDependencyTests-1740475853 None] Created volume successfully. Jul 11 18:50:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Creating offline snapshot a25b6105-d6bb-42bf-94ab-749fa147eb8a of volume bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:50:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[990686b7-fcc0-4c34-9c15-359de8f86444]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:02 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e Jul 11 18:50:02 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:03 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e" returned: 0 in 0.993s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:03 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a 1G Jul 11 18:50:03 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:04 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a 1G" returned: 0 in 1.026s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce19ee6-753d-422b-b96b-86669504a09e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:04 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce19ee6-753d-422b-b96b-86669504a09e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a Jul 11 18:50:04 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Flow 'volume_create_manager' (82c5ce3d-e31f-4bfb-8377-91cd70674a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211b95ae-b5f5-4802-af87-c58769e7e54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211b95ae-b5f5-4802-af87-c58769e7e54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-422915795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4844dfe4-7ee2-4102-89eb-f699858903fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864dcb97a8c4aa885ee74ff17571b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:04Z,use_quota=True,user_id='84c6a6872c8548e98cfb70203d2f50aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00b073e-0ac1-46c6-937c-33d0a63016aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00b073e-0ac1-46c6-937c-33d0a63016aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00ae821-7ee2-4666-84ac-858737804537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00ae821-7ee2-4666-84ac-858737804537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4844dfe4-7ee2-4102-89eb-f699858903fa', 'volume_name': 'volume-4844dfe4-7ee2-4102-89eb-f699858903fa', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af64db73-6f54-473f-a40b-26840d686cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af64db73-6f54-473f-a40b-26840d686cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44397ffd-85cd-491b-9e9c-5c7063fd6c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Volume 4844dfe4-7ee2-4102-89eb-f699858903fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4844dfe4-7ee2-4102-89eb-f699858903fa', 'volume_size': 1} Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:04 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce19ee6-753d-422b-b96b-86669504a09e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a" returned: 0 in 0.859s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:04 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a is being set with open permissions: ugo+rw Jul 11 18:50:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:05 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a Jul 11 18:50:05 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:05 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:05 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.info Jul 11 18:50:05 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:06 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.info" returned: 0 in 0.716s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:06 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.info is being set with open permissions: ugo+rw Jul 11 18:50:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:06 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.info Jul 11 18:50:06 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:07 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.info" returned: 0 in 0.707s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.170s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.909s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-422915795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4844dfe4-7ee2-4102-89eb-f699858903fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864dcb97a8c4aa885ee74ff17571b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:04Z,use_quota=True,user_id='84c6a6872c8548e98cfb70203d2f50aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Creating volume 4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:50:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3730b064-267a-40aa-aee1-d94209b5ea26 tempest-SnapshotDependencyTests-1740475853 None] Create snapshot completed successfully Jul 11 18:50:07 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa 1073741824 Jul 11 18:50:07 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:08 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa 1073741824" returned: 0 in 0.906s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:08 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa Jul 11 18:50:08 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:08 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa" returned: 0 in 0.744s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44397ffd-85cd-491b-9e9c-5c7063fd6c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4844dfe4-7ee2-4102-89eb-f699858903fa', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e1ad96-beff-4e95-8665-a18096d0b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Volume volume-4844dfe4-7ee2-4102-89eb-f699858903fa (4844dfe4-7ee2-4102-89eb-f699858903fa): created successfully Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e1ad96-beff-4e95-8665-a18096d0b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Flow 'volume_create_manager' (82c5ce3d-e31f-4bfb-8377-91cd70674a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3aa285dc-086d-4b3b-b40e-0be3d420d2b7 tempest-VolumesDeleteCascade-325546216 None] Created volume successfully. Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Flow 'volume_create_manager' (9e36b3ea-586e-4791-b2e3-6c71443cab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51369505-77cb-461f-9399-341f0e993233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51369505-77cb-461f-9399-341f0e993233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456f8bba-b36a-4f9d-8d9d-059bcdecb15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc92b7f92e54271b83fb26d09065705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a25b6105-d6bb-42bf-94ab-749fa147eb8a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:09Z,use_quota=True,user_id='1ef12719db25420caa362c3d466f90bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5a55af-e575-4396-b227-e7a37c67c832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5a55af-e575-4396-b227-e7a37c67c832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca90ff7-2310-4387-89b1-b8415f63be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca90ff7-2310-4387-89b1-b8415f63be61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '456f8bba-b36a-4f9d-8d9d-059bcdecb15c', 'volume_name': 'volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c', 'volume_size': 1, 'snapshot_id': 'a25b6105-d6bb-42bf-94ab-749fa147eb8a'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4af2d2b-aece-4752-b08a-ffe39c2f9158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4af2d2b-aece-4752-b08a-ffe39c2f9158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8592fa5f-221b-4446-8688-23d10ab4fd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Volume 456f8bba-b36a-4f9d-8d9d-059bcdecb15c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c', 'volume_size': 1, 'snapshot_id': 'a25b6105-d6bb-42bf-94ab-749fa147eb8a'} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-quobyte-a25b6105-d6bb-42bf-94ab-749fa147eb8a-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-a25b6105-d6bb-42bf-94ab-749fa147eb8a-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Creating volume 456f8bba-b36a-4f9d-8d9d-059bcdecb15c from snapshot a25b6105-d6bb-42bf-94ab-749fa147eb8a {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-quobyte-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] snapshot: a25b6105-d6bb-42bf-94ab-749fa147eb8a, volume: 456f8bba-b36a-4f9d-8d9d-059bcdecb15c, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc7aef-f485-41d0-b1ad-9c21b70bc025]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:09 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a Jul 11 18:50:09 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:10 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a" returned: 0 in 0.881s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bce19ee6-753d-422b-b96b-86669504a09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df31134-7acd-4f4e-92a1-5ab19fc89864]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:10 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e Jul 11 18:50:10 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:10 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e" returned: 0 in 0.776s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:50:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:11 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c Jul 11 18:50:11 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Flow 'volume_create_manager' (c07e6ce7-474f-4ab2-a75e-a00641a8c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96252eaa-c0f3-43f1-97d1-e76df27fd4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96252eaa-c0f3-43f1-97d1-e76df27fd4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1506721109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df4e37b-d4ee-4af0-89b2-f38e3b63a33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417046669fb842c5a76435a68b0551a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:15Z,use_quota=True,user_id='b2019e6837314094ad32e80975320142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9838c5ac-b095-4001-9f35-06cf65e044fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9838c5ac-b095-4001-9f35-06cf65e044fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea40315-5917-4987-a470-c14ea733a100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea40315-5917-4987-a470-c14ea733a100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df4e37b-d4ee-4af0-89b2-f38e3b63a33c', 'volume_name': 'volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dbbc38-4947-40d1-8ce9-c5aa132d36b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dbbc38-4947-40d1-8ce9-c5aa132d36b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f115a44c-5926-4444-8153-335f8c4dd056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Volume 4df4e37b-d4ee-4af0-89b2-f38e3b63a33c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c', 'volume_size': 1} Jul 11 18:50:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:50:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:15 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:50:15 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:16 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:16 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:50:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:50:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:50:17 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" returned: 0 in 6.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[98334422-855f-4fd3-ae1c-a40614aafbce]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:17 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e Jul 11 18:50:17 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:18 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e" returned: 0 in 0.974s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:50:18 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Converted 1024.00 MB image at 169.16 MB/s Jul 11 18:50:18 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c is being set with open permissions: ugo+rw Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:18 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c Jul 11 18:50:18 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:18 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" returned: 0 in 0.644s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" released by "_copy_volume_from_snapshot" :: held 9.421s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-a25b6105-d6bb-42bf-94ab-749fa147eb8a-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" released by "_create_volume_from_snapshot" :: held 9.459s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.474s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.904s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Creating offline snapshot b34889de-aa92-4c8a-be80-a49cd7a7c13e of volume 4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8592fa5f-221b-4446-8688-23d10ab4fd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c', 'volume_size': 1, 'snapshot_id': 'a25b6105-d6bb-42bf-94ab-749fa147eb8a'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f051f76f-9363-4ab6-a1ab-268b60b0f362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f852ee6-4d0b-47b1-909c-c62134b6f162]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Volume volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c (456f8bba-b36a-4f9d-8d9d-059bcdecb15c): created successfully Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f051f76f-9363-4ab6-a1ab-268b60b0f362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Flow 'volume_create_manager' (9e36b3ea-586e-4791-b2e3-6c71443cab18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-77918039-95e8-4de5-b7d4-34330201ffc2 tempest-SnapshotDependencyTests-1740475853 None] Created volume successfully. Jul 11 18:50:18 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa Jul 11 18:50:18 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-a25b6105-d6bb-42bf-94ab-749fa147eb8a-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-a25b6105-d6bb-42bf-94ab-749fa147eb8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-quobyte-bce19ee6-753d-422b-b96b-86669504a09e" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-bce19ee6-753d-422b-b96b-86669504a09e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-quobyte-a25b6105-d6bb-42bf-94ab-749fa147eb8a" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-a25b6105-d6bb-42bf-94ab-749fa147eb8a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Deleting offline snapshot a25b6105-d6bb-42bf-94ab-749fa147eb8a of volume bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] snapshot_file for this snap is: volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8964df80-f127-45b0-ace4-287cf019d7d0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:19 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a Jul 11 18:50:19 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:19 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa" returned: 0 in 0.909s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:19 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e 1G Jul 11 18:50:19 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:20 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a" returned: 0 in 0.862s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bce19ee6-753d-422b-b96b-86669504a09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49fec50-d22d-4212-bd8a-12fa281ac584]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:20 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e Jul 11 18:50:20 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:20 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e 1G" returned: 0 in 1.018s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4844dfe4-7ee2-4102-89eb-f699858903fa -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:20 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4844dfe4-7ee2-4102-89eb-f699858903fa -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e Jul 11 18:50:20 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:21 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e" returned: 0 in 0.972s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:21 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a Jul 11 18:50:21 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:21 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4844dfe4-7ee2-4102-89eb-f699858903fa -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e" returned: 0 in 0.837s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:21 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e is being set with open permissions: ugo+rw Jul 11 18:50:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:21 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e Jul 11 18:50:21 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:21 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a" returned: 0 in 0.862s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:22 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a Jul 11 18:50:22 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:22 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e" returned: 0 in 0.719s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:22 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.info Jul 11 18:50:22 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:22 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e.a25b6105-d6bb-42bf-94ab-749fa147eb8a" returned: 0 in 0.718s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-a25b6105-d6bb-42bf-94ab-749fa147eb8a" released by "_delete_snapshot" :: held 3.574s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-bce19ee6-753d-422b-b96b-86669504a09e" released by "delete_snapshot" :: held 3.603s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Created reservations ['661c7f47-c6e7-4d41-b538-d73609173556', '9e9611ce-b43b-4d39-897d-473f60346318', '8a2c1f2c-8aa4-4e40-92ae-928905c2db31', '5d22b827-ce87-4be6-9775-514102821471'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Delete snapshot completed successfully. Jul 11 18:50:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-59b94256-1a47-4e89-be17-006fb75049f2 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-a25b6105-d6bb-42bf-94ab-749fa147eb8a-delete_snapshot" released by "delete_snapshot" :: held 3.773s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:23 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.info" returned: 0 in 0.773s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:23 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.info is being set with open permissions: ugo+rw Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:23 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.info Jul 11 18:50:23 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-bce19ee6-753d-422b-b96b-86669504a09e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-bce19ee6-753d-422b-b96b-86669504a09e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-quobyte-bce19ee6-753d-422b-b96b-86669504a09e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-bce19ee6-753d-422b-b96b-86669504a09e" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc425d80-8b7e-4e5b-9259-745ecaa1de31]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:23 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e Jul 11 18:50:23 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:23 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.info" returned: 0 in 0.716s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.112s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.932s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1506721109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df4e37b-d4ee-4af0-89b2-f38e3b63a33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417046669fb842c5a76435a68b0551a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:15Z,use_quota=True,user_id='b2019e6837314094ad32e80975320142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Creating volume 4df4e37b-d4ee-4af0-89b2-f38e3b63a33c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:23 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:50:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:23 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c 1073741824 Jul 11 18:50:23 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-de42a01d-0567-4e9c-a177-3cec7bf9419c tempest-VolumesDeleteCascade-325546216 None] Create snapshot completed successfully Jul 11 18:50:24 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e" returned: 0 in 0.877s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:24 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e Jul 11 18:50:24 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:24 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c 1073741824" returned: 0 in 1.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:24 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c Jul 11 18:50:24 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:25 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bce19ee6-753d-422b-b96b-86669504a09e" returned: 0 in 0.796s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-bce19ee6-753d-422b-b96b-86669504a09e" released by "delete_volume" :: held 1.757s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Created reservations ['c99379db-ad1f-4f18-a279-0717281240e0', '05b37cd7-8924-498d-a293-777d0aa8144d', '16c4691a-4f02-4d0f-899b-5b6c2d6c5b55', '6222c163-1aeb-4c57-a7e0-e926dd41ebb1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:25 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:50:25 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:25 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c" returned: 0 in 0.725s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.853s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-456f8bba-b36a-4f9d-8d9d-059bcdecb15c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f115a44c-5926-4444-8153-335f8c4dd056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840030b1-1caa-42ba-aeec-aef752b1a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Creating offline snapshot 4442337f-bbdb-4ce6-a48f-a8d38568d90b of volume 4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:50:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Volume volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c (4df4e37b-d4ee-4af0-89b2-f38e3b63a33c): created successfully Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840030b1-1caa-42ba-aeec-aef752b1a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Flow 'volume_create_manager' (c07e6ce7-474f-4ab2-a75e-a00641a8c455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e4b693-686e-4096-b906-901e3c78b2a3]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-456f8bba-b36a-4f9d-8d9d-059bcdecb15c-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1e56831e-35d8-480f-958e-b2f8ab6bbfc6 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Created volume successfully. Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "cinder-quobyte-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cf2e21-734e-4453-8b8c-9a95f043175f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:25 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e Jul 11 18:50:25 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:26 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c Jul 11 18:50:26 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:26 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.682s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:26 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Deleted volume successfully. Jul 11 18:50:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2bccbe76-1c30-44e2-962b-d00125b90737 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-bce19ee6-753d-422b-b96b-86669504a09e-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:26 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e" returned: 0 in 0.847s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4844dfe4-7ee2-4102-89eb-f699858903fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:26 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b 1G Jul 11 18:50:26 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:26 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" returned: 0 in 0.812s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:26 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c Jul 11 18:50:26 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:27 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" returned: 0 in 0.735s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-quobyte-456f8bba-b36a-4f9d-8d9d-059bcdecb15c" released by "delete_volume" :: held 1.596s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Created reservations ['bc52ce98-8abc-4dd5-ba28-81b497c86e4b', '301d066f-1e59-4355-90d1-66ec717878ea', 'dea1050e-1955-4eed-9da4-0751b80076ef', '9ef773ef-4643-49d1-aefd-4a5bea6d1eb5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:27 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b 1G" returned: 0 in 0.974s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:27 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:50:27 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:27 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b Jul 11 18:50:27 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:28 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:28 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Deleted volume successfully. Jul 11 18:50:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43009c02-4721-4306-be65-8a68362bb920 tempest-SnapshotDependencyTests-1740475853 None] Lock "cinder-456f8bba-b36a-4f9d-8d9d-059bcdecb15c-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:28 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b" returned: 0 in 0.754s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:28 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b is being set with open permissions: ugo+rw Jul 11 18:50:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:28 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b Jul 11 18:50:28 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:29 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b" returned: 0 in 0.717s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.530s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-99652ac7-8422-4942-aa38-8e847f374926 tempest-VolumesDeleteCascade-325546216 None] Create snapshot completed successfully Jul 11 18:50:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a1089deb-a595-49a7-920d-fe422cb2bdfc req-ec9acd45-85b1-4d08-a545-61e1c54a3fdd tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a1089deb-a595-49a7-920d-fe422cb2bdfc req-ec9acd45-85b1-4d08-a545-61e1c54a3fdd tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[84648c41-74bc-437d-a474-670835600771]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a1089deb-a595-49a7-920d-fe422cb2bdfc req-ec9acd45-85b1-4d08-a545-61e1c54a3fdd tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:30 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c Jul 11 18:50:30 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-4844dfe4-7ee2-4102-89eb-f699858903fa-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-4844dfe4-7ee2-4102-89eb-f699858903fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Performing cascade delete. {{(pid=87167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-4442337f-bbdb-4ce6-a48f-a8d38568d90b-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-4442337f-bbdb-4ce6-a48f-a8d38568d90b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-4442337f-bbdb-4ce6-a48f-a8d38568d90b" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4442337f-bbdb-4ce6-a48f-a8d38568d90b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Deleting offline snapshot 4442337f-bbdb-4ce6-a48f-a8d38568d90b of volume 4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] snapshot_file for this snap is: volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f746b-edb9-431b-bd62-36f5dba789e9]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:30 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b Jul 11 18:50:30 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:30 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a1089deb-a595-49a7-920d-fe422cb2bdfc req-ec9acd45-85b1-4d08-a545-61e1c54a3fdd tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c" returned: 0 in 1.081s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a1089deb-a595-49a7-920d-fe422cb2bdfc req-ec9acd45-85b1-4d08-a545-61e1c54a3fdd tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a1089deb-a595-49a7-920d-fe422cb2bdfc req-ec9acd45-85b1-4d08-a545-61e1c54a3fdd tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2687ef8-beb4-4e87-96f1-0029c09da989', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:50:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-a1089deb-a595-49a7-920d-fe422cb2bdfc req-ec9acd45-85b1-4d08-a545-61e1c54a3fdd tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] attachment_update completed successfully. Jul 11 18:50:31 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b" returned: 0 in 1.136s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4844dfe4-7ee2-4102-89eb-f699858903fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef271f9c-f5bf-4619-8881-3e963f31d486]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:31 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e Jul 11 18:50:31 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:32 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e" returned: 0 in 1.081s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4844dfe4-7ee2-4102-89eb-f699858903fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:32 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b Jul 11 18:50:32 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:33 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b" returned: 0 in 0.917s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:33 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b Jul 11 18:50:33 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:34 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.4442337f-bbdb-4ce6-a48f-a8d38568d90b" returned: 0 in 0.723s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4442337f-bbdb-4ce6-a48f-a8d38568d90b" released by "_delete_snapshot" :: held 3.986s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" released by "delete_snapshot" :: held 4.014s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Created reservations ['b439322f-726c-497e-81c1-69305c711b3e', '3219606b-e763-42b7-8cdf-7cebae72bad9', 'f92061e1-45ce-4889-95be-4bc15981f92d', '3801d986-4232-4648-ac98-603171e4844a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Delete snapshot completed successfully. Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-4442337f-bbdb-4ce6-a48f-a8d38568d90b-delete_snapshot" released by "delete_snapshot" :: held 4.201s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-b34889de-aa92-4c8a-be80-a49cd7a7c13e-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-b34889de-aa92-4c8a-be80-a49cd7a7c13e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-b34889de-aa92-4c8a-be80-a49cd7a7c13e" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-b34889de-aa92-4c8a-be80-a49cd7a7c13e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Deleting offline snapshot b34889de-aa92-4c8a-be80-a49cd7a7c13e of volume 4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] snapshot_file for this snap is: volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a117626-e51b-4fcd-a369-e7364f31cf5f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:34 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e Jul 11 18:50:34 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:35 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e" returned: 0 in 0.851s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4844dfe4-7ee2-4102-89eb-f699858903fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be7fc53-557f-4206-a92f-afbb5ee7a595]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:35 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa Jul 11 18:50:35 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:36 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa" returned: 0 in 0.907s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:36 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e Jul 11 18:50:36 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:37 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e" returned: 0 in 1.223s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:37 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e Jul 11 18:50:37 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:38 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa.b34889de-aa92-4c8a-be80-a49cd7a7c13e" returned: 0 in 0.966s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-b34889de-aa92-4c8a-be80-a49cd7a7c13e" released by "_delete_snapshot" :: held 4.071s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" released by "delete_snapshot" :: held 4.107s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Created reservations ['2a68272d-92b8-4206-9b7b-cfb92234276a', '93019d6b-f7ac-48a5-9754-c15d64aff275', '7c5b49da-1812-4dca-acd5-073dd13b0206', '774e5745-b3d0-4cd0-980d-e71c74e5e7c4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Delete snapshot completed successfully. Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-b34889de-aa92-4c8a-be80-a49cd7a7c13e-delete_snapshot" released by "delete_snapshot" :: held 4.301s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Snapshots deleted, issuing volume delete {{(pid=87167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eba10a6-a3aa-4d5c-b3f9-2956f0e137d3]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:39 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa Jul 11 18:50:39 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:39 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa" returned: 0 in 0.999s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:39 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa Jul 11 18:50:39 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:40 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4844dfe4-7ee2-4102-89eb-f699858903fa" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4844dfe4-7ee2-4102-89eb-f699858903fa" released by "delete_volume" :: held 1.756s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Created reservations ['4f63b73e-8283-471c-90e5-5b5cd936bb5a', '01e45722-effd-465f-94df-27c997facd7a', '5c63ef91-a04c-4d5e-969e-8d1fd384149c', 'd2182230-7a72-4a49-9b37-219bbda8e743'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:40 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:50:40 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:41 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.836s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Deleted volume successfully. Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85b8c8a9-eeca-4d47-8630-6a7a60622c32 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-4844dfe4-7ee2-4102-89eb-f699858903fa-delete_volume" released by "delete_volume" :: held 11.420s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Flow 'volume_create_manager' (e78d9059-3daf-404c-bdd7-8fb9798834d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8999f614-f1a2-4fd9-979b-ed0095da74a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8999f614-f1a2-4fd9-979b-ed0095da74a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-156369264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20e4efd-f2bf-48e1-ae52-4af6681155dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864dcb97a8c4aa885ee74ff17571b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:42Z,use_quota=True,user_id='84c6a6872c8548e98cfb70203d2f50aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0ea143-4a44-49b2-838e-bc91030ec6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0ea143-4a44-49b2-838e-bc91030ec6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0650da33-5b3f-485b-9241-8957abfa5af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0650da33-5b3f-485b-9241-8957abfa5af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20e4efd-f2bf-48e1-ae52-4af6681155dc', 'volume_name': 'volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c14c731-ca9c-461d-8fdd-fb458005408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c14c731-ca9c-461d-8fdd-fb458005408a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfb05e4-a9a3-4414-a55d-df2b3c769a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Volume b20e4efd-f2bf-48e1-ae52-4af6681155dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc', 'volume_size': 1} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-156369264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20e4efd-f2bf-48e1-ae52-4af6681155dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864dcb97a8c4aa885ee74ff17571b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:42Z,use_quota=True,user_id='84c6a6872c8548e98cfb70203d2f50aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Creating volume b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:41 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:50:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:41 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc 1073741824 Jul 11 18:50:41 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-e7410ac9-3616-4a9a-9b2c-ba043954337a req-65666ee5-86d4-4961-bf19-baefab4c0b21 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Terminate volume connection completed successfully. Jul 11 18:50:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-e7410ac9-3616-4a9a-9b2c-ba043954337a req-65666ee5-86d4-4961-bf19-baefab4c0b21 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Deleting attachment c2687ef8-beb4-4e87-96f1-0029c09da989. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:50:42 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc 1073741824" returned: 0 in 0.988s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:43 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc Jul 11 18:50:43 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:43 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc" returned: 0 in 0.752s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfb05e4-a9a3-4414-a55d-df2b3c769a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383e85d9-f975-4e5b-bea3-b38aaf01887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Volume volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc (b20e4efd-f2bf-48e1-ae52-4af6681155dc): created successfully Jul 11 18:50:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383e85d9-f975-4e5b-bea3-b38aaf01887c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Flow 'volume_create_manager' (e78d9059-3daf-404c-bdd7-8fb9798834d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-54e70a5b-f16c-487c-ac55-da9e36c66def tempest-VolumesDeleteCascade-325546216 None] Created volume successfully. Jul 11 18:50:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Acquiring lock "cinder-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "cinder-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Acquiring lock "cinder-quobyte-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "cinder-quobyte-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee13e9-908c-40d8-9a7d-6bad05329390]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:44 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c Jul 11 18:50:44 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Creating offline snapshot 41986224-1bf5-4bac-b47c-f9c1df6b55ab of volume b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:50:45 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c" returned: 0 in 0.857s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7994501-d6f2-4485-9c5c-de9b823c45d0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:45 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c Jul 11 18:50:45 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:45 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc Jul 11 18:50:45 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:45 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c" returned: 0 in 0.652s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "cinder-quobyte-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c" released by "delete_volume" :: held 1.563s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Created reservations ['b087bfe4-2b87-4ed6-a4b8-aed6a4ea0f87', 'e6b4a67a-1555-4af7-bee3-dd7f32e274f3', '799087fc-0ae1-4695-84cf-4cb6f8ea262a', '5370542c-3d6f-42f1-b1c3-5ea0d0bb17cd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:46 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:50:46 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:46 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc" returned: 0 in 0.835s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:46 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab 1G Jul 11 18:50:46 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:46 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.790s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Deleted volume successfully. Jul 11 18:50:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97ffc46-23c8-452d-b7a3-243b5cffa009 tempest-TestServerVolumeAttachScenarioOldVersion-1220015502 None] Lock "cinder-4df4e37b-d4ee-4af0-89b2-f38e3b63a33c-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:47 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab 1G" returned: 0 in 0.956s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:47 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab Jul 11 18:50:47 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:47 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:47 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab is being set with open permissions: ugo+rw Jul 11 18:50:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:47 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab Jul 11 18:50:47 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab" returned: 0 in 0.696s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:48 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:48 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.info Jul 11 18:50:48 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:49 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.info" returned: 0 in 0.859s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:49 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.info is being set with open permissions: ugo+rw Jul 11 18:50:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:49 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.info Jul 11 18:50:49 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:50 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.info" returned: 0 in 0.803s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.087s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7d4e2757-25a0-46df-9b71-b078e9850e04 tempest-VolumesDeleteCascade-325546216 None] Create snapshot completed successfully Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Flow 'volume_create_manager' (056b1775-dc60-4182-890a-cfc20eb510bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e0163a-0df8-48fd-ae0b-435a1315d57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e0163a-0df8-48fd-ae0b-435a1315d57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-943612114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864dcb97a8c4aa885ee74ff17571b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41986224-1bf5-4bac-b47c-f9c1df6b55ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:51Z,use_quota=True,user_id='84c6a6872c8548e98cfb70203d2f50aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23aab2e-ac03-4b45-a18c-b4d6fd312632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23aab2e-ac03-4b45-a18c-b4d6fd312632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9ecd96-a5cb-494d-bc2e-e458afa8d003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9ecd96-a5cb-494d-bc2e-e458afa8d003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1', 'volume_name': 'volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1', 'volume_size': 1, 'snapshot_id': '41986224-1bf5-4bac-b47c-f9c1df6b55ab'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8c0ede-70c8-489f-82ef-8c360bd4d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8c0ede-70c8-489f-82ef-8c360bd4d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d690d48c-dd6d-4e0f-998c-aa4e45a429bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Volume 4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1', 'volume_size': 1, 'snapshot_id': '41986224-1bf5-4bac-b47c-f9c1df6b55ab'} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-41986224-1bf5-4bac-b47c-f9c1df6b55ab-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-41986224-1bf5-4bac-b47c-f9c1df6b55ab-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Creating volume 4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 from snapshot 41986224-1bf5-4bac-b47c-f9c1df6b55ab {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] snapshot: 41986224-1bf5-4bac-b47c-f9c1df6b55ab, volume: 4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e55c3-ba9e-4c31-8fd8-04c6f4db2c98]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:51 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab Jul 11 18:50:51 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:52 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab" returned: 0 in 0.876s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c85c0cd-9e0a-44dc-bd0d-be54d9810c86]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:52 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc Jul 11 18:50:52 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:52 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:50:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:52 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 Jul 11 18:50:52 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:58 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" returned: 0 in 5.208s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[116aac8b-6d5b-4f03-a2c1-b3b1e2561f8f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:58 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc Jul 11 18:50:58 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:59 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc" returned: 0 in 1.042s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:59 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:50:59 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Converted 1024.00 MB image at 196.56 MB/s Jul 11 18:50:59 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 is being set with open permissions: ugo+rw Jul 11 18:50:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:59 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 Jul 11 18:50:59 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:00 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" returned: 0 in 0.857s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" released by "_copy_volume_from_snapshot" :: held 8.840s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-41986224-1bf5-4bac-b47c-f9c1df6b55ab-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" released by "_create_volume_from_snapshot" :: held 8.874s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.893s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=73,cinder:INSERT=15,cinder:UPDATE=74,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:DELETE=12,cinder:SELECT=63,cinder:UPDATE=66,cinder:INSERT=20 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d690d48c-dd6d-4e0f-998c-aa4e45a429bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1', 'volume_size': 1, 'snapshot_id': '41986224-1bf5-4bac-b47c-f9c1df6b55ab'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074e9b06-c7af-4cf4-a2f9-e7edafdc2899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Volume volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 (4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1): created successfully Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074e9b06-c7af-4cf4-a2f9-e7edafdc2899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Flow 'volume_create_manager' (056b1775-dc60-4182-890a-cfc20eb510bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5112fd39-11bc-4310-8889-33d9b1370ad1 tempest-VolumesDeleteCascade-325546216 None] Created volume successfully. Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-b20e4efd-f2bf-48e1-ae52-4af6681155dc-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-b20e4efd-f2bf-48e1-ae52-4af6681155dc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Performing cascade delete. {{(pid=87167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-41986224-1bf5-4bac-b47c-f9c1df6b55ab-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-41986224-1bf5-4bac-b47c-f9c1df6b55ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-b20e4efd-f2bf-48e1-ae52-4af6681155dc" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-b20e4efd-f2bf-48e1-ae52-4af6681155dc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-41986224-1bf5-4bac-b47c-f9c1df6b55ab" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-41986224-1bf5-4bac-b47c-f9c1df6b55ab" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Deleting offline snapshot 41986224-1bf5-4bac-b47c-f9c1df6b55ab of volume b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] snapshot_file for this snap is: volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ad92ef-ace2-42b3-a71b-79c403c53617]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:01 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab Jul 11 18:51:01 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:02 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab" returned: 0 in 0.801s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:51:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e453e7-349c-4127-9d5d-c4af79f92f37]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:02 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc Jul 11 18:51:02 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:03 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc" returned: 0 in 0.855s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:03 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab Jul 11 18:51:03 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Flow 'volume_create_manager' (d7d06e7d-b1e7-473b-95d5-1edd40736c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9cf8de-e9fa-4c73-b85a-bea1ed283c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab" returned: 0 in 1.075s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9cf8de-e9fa-4c73-b85a-bea1ed283c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-630956089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d9f37a-8735-42a4-8bd5-b2a125ce9fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71dba33a61445778249662de6d87eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:04Z,use_quota=True,user_id='cd736ca3222540ff888561ae3e5b7e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6018004e-f4ad-494e-a14c-5d22a464a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6018004e-f4ad-494e-a14c-5d22a464a45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:04 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240e87e5-711a-42fc-92e4-5b53d8eb979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240e87e5-711a-42fc-92e4-5b53d8eb979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d9f37a-8735-42a4-8bd5-b2a125ce9fee', 'volume_name': 'volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2197df1-b46d-4a91-b5f8-038e72279f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2197df1-b46d-4a91-b5f8-038e72279f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efca2871-1f01-4ea2-b344-e300f6adac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Volume e7d9f37a-8735-42a4-8bd5-b2a125ce9fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee', 'volume_size': 1} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-630956089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d9f37a-8735-42a4-8bd5-b2a125ce9fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71dba33a61445778249662de6d87eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:04Z,use_quota=True,user_id='cd736ca3222540ff888561ae3e5b7e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Creating volume e7d9f37a-8735-42a4-8bd5-b2a125ce9fee {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:51:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:04 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee 1073741824 Jul 11 18:51:04 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:05 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc.41986224-1bf5-4bac-b47c-f9c1df6b55ab" returned: 0 in 0.888s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-41986224-1bf5-4bac-b47c-f9c1df6b55ab" released by "_delete_snapshot" :: held 3.732s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-b20e4efd-f2bf-48e1-ae52-4af6681155dc" released by "delete_snapshot" :: held 3.766s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Created reservations ['ed055d83-ac0b-4eb9-b033-3df83c732d1e', 'dd0daafe-268d-4947-985e-3271651cb3bf', '6eb9d6af-0ab7-4133-9682-093dc659998b', 'e46ae1ce-e374-4fe3-b509-1d51ec49d1fb'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Delete snapshot completed successfully. Jul 11 18:51:05 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee 1073741824" returned: 0 in 1.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-41986224-1bf5-4bac-b47c-f9c1df6b55ab-delete_snapshot" released by "delete_snapshot" :: held 4.002s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Snapshots deleted, issuing volume delete {{(pid=87167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-b20e4efd-f2bf-48e1-ae52-4af6681155dc" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-b20e4efd-f2bf-48e1-ae52-4af6681155dc" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[59075556-e6ea-42aa-872b-035122045130]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:05 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee Jul 11 18:51:05 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:05 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc Jul 11 18:51:05 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:06 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee" returned: 0 in 0.705s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efca2871-1f01-4ea2-b344-e300f6adac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1a1f1a-c178-4530-9276-f2a702500942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Volume volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee (e7d9f37a-8735-42a4-8bd5-b2a125ce9fee): created successfully Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1a1f1a-c178-4530-9276-f2a702500942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Flow 'volume_create_manager' (d7d06e7d-b1e7-473b-95d5-1edd40736c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-de3b3266-d394-4584-9613-c7f4430c261e tempest-AttachVolumeNegativeTest-1554925873 None] Created volume successfully. Jul 11 18:51:06 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc" returned: 0 in 0.825s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:06 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc Jul 11 18:51:06 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:06 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b20e4efd-f2bf-48e1-ae52-4af6681155dc" returned: 0 in 0.689s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-b20e4efd-f2bf-48e1-ae52-4af6681155dc" released by "delete_volume" :: held 1.572s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Created reservations ['23879c2c-af50-4983-b0a8-393971a15396', '732f6659-11d8-4bf9-96ea-b6794891c1c3', '87ce07d0-1e17-4527-b0c2-5ef9731c5462', 'c4c15ad7-5740-4c5f-85c7-1add6cac27ea'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:07 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:51:07 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:07 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.675s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Deleted volume successfully. Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0892936-b2c0-47e0-9c92-1292e558ac2e tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-b20e4efd-f2bf-48e1-ae52-4af6681155dc-delete_volume" released by "delete_volume" :: held 6.524s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "cinder-quobyte-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ac39fb-3ebf-4aab-aa8e-1d2089b9b4c5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:08 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 Jul 11 18:51:08 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:08 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" returned: 0 in 0.804s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:08 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1 Jul 11 18:51:08 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:09 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-quobyte-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1" released by "delete_volume" :: held 1.528s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Created reservations ['2200a1c3-dde5-494a-b366-931ab23d1fdb', '75ed9c42-d8d3-4765-8a1d-a1904f5cc382', 'cf4548d4-7449-4161-a92d-27d2e7964790', 'd984b28b-eac9-49d1-ab93-ef8c15255b58'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:09 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:51:09 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:10 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.703s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:10 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Deleted volume successfully. Jul 11 18:51:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cc18938-66f3-48f0-9b92-da33507af839 tempest-VolumesDeleteCascade-325546216 None] Lock "cinder-4e8ae473-ddbe-4f7d-b2c6-04c7c8155fe1-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-38e3c98d-1416-40ab-8ef3-09ef29eede86 req-1a75cf88-949a-4106-a299-7588e26d8381 tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-38e3c98d-1416-40ab-8ef3-09ef29eede86 req-1a75cf88-949a-4106-a299-7588e26d8381 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3657bf0-c508-4885-be8c-ad9913372a08]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-38e3c98d-1416-40ab-8ef3-09ef29eede86 req-1a75cf88-949a-4106-a299-7588e26d8381 tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:10 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee Jul 11 18:51:10 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:11 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-38e3c98d-1416-40ab-8ef3-09ef29eede86 req-1a75cf88-949a-4106-a299-7588e26d8381 tempest-AttachVolumeNegativeTest-1554925873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee" returned: 0 in 0.925s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-38e3c98d-1416-40ab-8ef3-09ef29eede86 req-1a75cf88-949a-4106-a299-7588e26d8381 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-38e3c98d-1416-40ab-8ef3-09ef29eede86 req-1a75cf88-949a-4106-a299-7588e26d8381 tempest-AttachVolumeNegativeTest-1554925873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47332b9d-9e1b-47bb-8bdf-10fa1656e740', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:51:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-38e3c98d-1416-40ab-8ef3-09ef29eede86 req-1a75cf88-949a-4106-a299-7588e26d8381 tempest-AttachVolumeNegativeTest-1554925873 None] attachment_update completed successfully. Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Flow 'volume_create_manager' (158be6cd-e8da-4dec-98cb-f1bd43aef33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c4843d-509e-4689-a66b-3bda1b79c675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c4843d-509e-4689-a66b-3bda1b79c675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-226202981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cba45d-1dfa-4769-9f77-49a3a29df09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82175f6383946c38f13095408132974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:13Z,use_quota=True,user_id='e81cc38d18184d5e8230c32327f5ea7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e0a8c5-4504-4b6d-b298-6acf3175ebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e0a8c5-4504-4b6d-b298-6acf3175ebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1477c6-c02b-45db-ac38-cf21bc2b10e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1477c6-c02b-45db-ac38-cf21bc2b10e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17cba45d-1dfa-4769-9f77-49a3a29df09f', 'volume_name': 'volume-17cba45d-1dfa-4769-9f77-49a3a29df09f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfd434f-0288-45e4-ad96-eb99c6fb4ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfd434f-0288-45e4-ad96-eb99c6fb4ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806a5552-2d11-4567-bb6d-a37683c8b431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Volume 17cba45d-1dfa-4769-9f77-49a3a29df09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17cba45d-1dfa-4769-9f77-49a3a29df09f', 'volume_size': 1} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-226202981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cba45d-1dfa-4769-9f77-49a3a29df09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82175f6383946c38f13095408132974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:13Z,use_quota=True,user_id='e81cc38d18184d5e8230c32327f5ea7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Creating volume 17cba45d-1dfa-4769-9f77-49a3a29df09f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:13 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:51:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:13 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f 1073741824 Jul 11 18:51:13 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:14 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f 1073741824" returned: 0 in 0.919s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:14 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f Jul 11 18:51:14 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:15 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:51:15 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:15 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f" returned: 0 in 0.695s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806a5552-2d11-4567-bb6d-a37683c8b431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cba45d-1dfa-4769-9f77-49a3a29df09f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afa11cf-c174-4e8b-b907-b607ea1afeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Volume volume-17cba45d-1dfa-4769-9f77-49a3a29df09f (17cba45d-1dfa-4769-9f77-49a3a29df09f): created successfully Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afa11cf-c174-4e8b-b907-b607ea1afeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Flow 'volume_create_manager' (158be6cd-e8da-4dec-98cb-f1bd43aef33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c6d0f633-37b0-4276-b96a-161448d70550 tempest-VolumesMetadataTest-1010314773 None] Created volume successfully. Jul 11 18:51:15 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.891s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:51:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:51:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Acquiring lock "cinder-17cba45d-1dfa-4769-9f77-49a3a29df09f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Lock "cinder-17cba45d-1dfa-4769-9f77-49a3a29df09f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Acquiring lock "cinder-quobyte-17cba45d-1dfa-4769-9f77-49a3a29df09f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Lock "cinder-quobyte-17cba45d-1dfa-4769-9f77-49a3a29df09f" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a6b2e4-408f-45d0-a70a-ee9fc4e0dd24]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:16 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f Jul 11 18:51:16 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:17 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f" returned: 0 in 0.906s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:17 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f Jul 11 18:51:17 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:18 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-17cba45d-1dfa-4769-9f77-49a3a29df09f" returned: 0 in 0.818s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Lock "cinder-quobyte-17cba45d-1dfa-4769-9f77-49a3a29df09f" released by "delete_volume" :: held 1.787s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Created reservations ['0b3b944f-b587-4f1f-b9c9-814519b39620', '4e6fb979-4e79-431d-8239-660e6ae50e0b', '2e53ae14-4e97-4a9b-8b9a-b76a9f7d0c5c', '1661b688-7270-455c-89f2-d1667d19d0a2'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:18 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:51:18 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:19 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.872s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Deleted volume successfully. Jul 11 18:51:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd42e01e-47ad-4814-8171-fb5fed0d36b7 tempest-VolumesMetadataTest-1010314773 None] Lock "cinder-17cba45d-1dfa-4769-9f77-49a3a29df09f-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Flow 'volume_create_manager' (823dcfe1-7d6b-48f4-a897-68459e7b11b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8641f9-4f85-4432-be40-99ccc92f6742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8641f9-4f85-4432-be40-99ccc92f6742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1720915935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7762eb-f0fa-4160-badc-dc9895f8768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f32c39e606c4201aea6eb95c25cb5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:25Z,use_quota=True,user_id='fcb6bdbf38a441a3bcd0f841ac23257c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d919d7-0607-468d-946e-4f60948b3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d919d7-0607-468d-946e-4f60948b3313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6d32b7-6a6c-4d69-b628-1f3cb89fb4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6d32b7-6a6c-4d69-b628-1f3cb89fb4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7762eb-f0fa-4160-badc-dc9895f8768d', 'volume_name': 'volume-cc7762eb-f0fa-4160-badc-dc9895f8768d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ba8ac5-091f-47a1-9f2e-5bc024cd060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ba8ac5-091f-47a1-9f2e-5bc024cd060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e085f6-efdd-4947-bafb-7fd7e21a8215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Volume cc7762eb-f0fa-4160-badc-dc9895f8768d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7762eb-f0fa-4160-badc-dc9895f8768d', 'volume_size': 1} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1720915935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7762eb-f0fa-4160-badc-dc9895f8768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f32c39e606c4201aea6eb95c25cb5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:25Z,use_quota=True,user_id='fcb6bdbf38a441a3bcd0f841ac23257c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Creating volume cc7762eb-f0fa-4160-badc-dc9895f8768d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:24 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:51:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:24 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d 1073741824 Jul 11 18:51:24 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:25 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d 1073741824" returned: 0 in 0.923s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:25 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d Jul 11 18:51:25 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:26 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d" returned: 0 in 0.751s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e085f6-efdd-4947-bafb-7fd7e21a8215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7762eb-f0fa-4160-badc-dc9895f8768d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87c04f6-9907-4cf3-b507-642b5daca372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Volume volume-cc7762eb-f0fa-4160-badc-dc9895f8768d (cc7762eb-f0fa-4160-badc-dc9895f8768d): created successfully Jul 11 18:51:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87c04f6-9907-4cf3-b507-642b5daca372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Flow 'volume_create_manager' (823dcfe1-7d6b-48f4-a897-68459e7b11b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-29ecef2d-64da-4acb-8b2b-a07ea7c44efe tempest-VolumesTransfersTest-2013882708 None] Created volume successfully. Jul 11 18:51:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-93e48f2c-4bef-4680-9965-b17addd84920 tempest-VolumesTransfersTest-451875873 None] Transfer volume completed successfully. Jul 11 18:51:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Acquiring lock "cinder-cc7762eb-f0fa-4160-badc-dc9895f8768d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Lock "cinder-cc7762eb-f0fa-4160-badc-dc9895f8768d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Acquiring lock "cinder-quobyte-cc7762eb-f0fa-4160-badc-dc9895f8768d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Lock "cinder-quobyte-cc7762eb-f0fa-4160-badc-dc9895f8768d" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0149d5da-b767-4d5f-8fde-065ffc8ddc23]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:28 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d Jul 11 18:51:28 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:29 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d" returned: 0 in 1.016s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:29 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d Jul 11 18:51:29 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:30 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cc7762eb-f0fa-4160-badc-dc9895f8768d" returned: 0 in 0.897s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Lock "cinder-quobyte-cc7762eb-f0fa-4160-badc-dc9895f8768d" released by "delete_volume" :: held 1.969s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Created reservations ['202653a6-019d-4914-9260-9b5b3401464e', '480f7da3-9bd1-4ed1-9fb8-baaf9ddc1eec', 'a349e189-6d6e-4922-b44e-8b2c0595ddd6', '75e9ef78-8ac2-4408-b918-80580d0dad62'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:30 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:51:30 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Flow 'volume_create_manager' (7f4a56e7-d76b-4ced-b5a6-9be47fedb19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bcb3da-dadb-494b-98d2-e99ff2feac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bcb3da-dadb-494b-98d2-e99ff2feac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-326911770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a84d9c-60b2-476e-b1f0-9f6c5bb6c904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f32c39e606c4201aea6eb95c25cb5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:32Z,use_quota=True,user_id='fcb6bdbf38a441a3bcd0f841ac23257c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5fafbb-0b77-4d24-bf11-e12842e04fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5fafbb-0b77-4d24-bf11-e12842e04fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9c999e-5050-4271-ab97-c7b60fa2fdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9c999e-5050-4271-ab97-c7b60fa2fdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49a84d9c-60b2-476e-b1f0-9f6c5bb6c904', 'volume_name': 'volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c453413-12bf-442d-ae9b-8ef7b7869fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c453413-12bf-442d-ae9b-8ef7b7869fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d820ee89-2c1e-4865-bc46-89c0e33647f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Volume 49a84d9c-60b2-476e-b1f0-9f6c5bb6c904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904', 'volume_size': 1} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-326911770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a84d9c-60b2-476e-b1f0-9f6c5bb6c904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f32c39e606c4201aea6eb95c25cb5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:32Z,use_quota=True,user_id='fcb6bdbf38a441a3bcd0f841ac23257c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Creating volume 49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:31 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 1073741824 Jul 11 18:51:31 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:31 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.168s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Deleted volume successfully. Jul 11 18:51:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86d49d3a-cfb8-4d52-913e-0f6dd386d1c8 tempest-VolumesTransfersTest-1456425120 None] Lock "cinder-cc7762eb-f0fa-4160-badc-dc9895f8768d-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:32 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 1073741824" returned: 0 in 1.053s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:32 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 Jul 11 18:51:32 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Flow 'volume_create_manager' (ec1ad76d-92dc-4a15-a392-2d3531280b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a21747-bda1-4d2c-99b7-5b1e5c0c77f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a21747-bda1-4d2c-99b7-5b1e5c0c77f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2135453742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46f108b-16ad-4d25-915c-c73a50029f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a0112a350447dc8304d12e0690710a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:33Z,use_quota=True,user_id='e472a8899b3f44b89b38361018a32013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3401810-6c6b-4248-aaec-c304a9da5669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3401810-6c6b-4248-aaec-c304a9da5669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076c7578-bee9-486f-8c9c-ab5d47db515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076c7578-bee9-486f-8c9c-ab5d47db515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46f108b-16ad-4d25-915c-c73a50029f75', 'volume_name': 'volume-e46f108b-16ad-4d25-915c-c73a50029f75', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e55cc1-5318-46c8-9704-22cd2b037661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e55cc1-5318-46c8-9704-22cd2b037661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ca1ba9-c23c-4826-9465-f9e144d04c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Volume e46f108b-16ad-4d25-915c-c73a50029f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46f108b-16ad-4d25-915c-c73a50029f75', 'volume_size': 1} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:33 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904" returned: 0 in 0.752s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2135453742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46f108b-16ad-4d25-915c-c73a50029f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a0112a350447dc8304d12e0690710a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:33Z,use_quota=True,user_id='e472a8899b3f44b89b38361018a32013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Creating volume e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d820ee89-2c1e-4865-bc46-89c0e33647f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c703e5-de02-46c0-94a6-b70581f247a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:33 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 1073741824 Jul 11 18:51:33 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Volume volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 (49a84d9c-60b2-476e-b1f0-9f6c5bb6c904): created successfully Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c703e5-de02-46c0-94a6-b70581f247a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Flow 'volume_create_manager' (7f4a56e7-d76b-4ced-b5a6-9be47fedb19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ed34bb41-01a0-4372-902e-6b8df97df529 tempest-VolumesTransfersTest-2013882708 None] Created volume successfully. Jul 11 18:51:34 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 1073741824" returned: 0 in 0.961s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:34 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 Jul 11 18:51:34 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Acquiring lock "cinder-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Lock "cinder-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Acquiring lock "cinder-quobyte-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Lock "cinder-quobyte-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcf798c-d14e-435a-a0ab-0605fb050f29]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:35 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75" returned: 0 in 0.823s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ca1ba9-c23c-4826-9465-f9e144d04c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46f108b-16ad-4d25-915c-c73a50029f75', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e2c79f-cfba-4dff-ac4e-d8318f6eff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Volume volume-e46f108b-16ad-4d25-915c-c73a50029f75 (e46f108b-16ad-4d25-915c-c73a50029f75): created successfully Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e2c79f-cfba-4dff-ac4e-d8318f6eff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Flow 'volume_create_manager' (ec1ad76d-92dc-4a15-a392-2d3531280b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:35 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 Jul 11 18:51:35 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9d1fd61e-362f-4fd5-a404-3a680e89acef tempest-TestStampPattern-222445202 None] Created volume successfully. Jul 11 18:51:36 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904" returned: 0 in 0.995s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:36 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904 Jul 11 18:51:36 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:37 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904" returned: 0 in 0.702s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Lock "cinder-quobyte-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904" released by "delete_volume" :: held 1.752s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Created reservations ['d1c3e0b5-dea8-4480-bb3d-08f6b0fdb084', 'b691021a-1e8b-4f2c-a2bb-3a6a05f30916', 'a819b457-6340-4c89-84b5-1f731fbd19b7', '00e9de74-89f4-4e54-bced-9960ac5ec880'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:37 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:51:37 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:38 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.838s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:38 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Deleted volume successfully. Jul 11 18:51:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ff111362-92c1-415d-84e3-b95835cbbdf5 tempest-VolumesTransfersTest-1456425120 None] Lock "cinder-49a84d9c-60b2-476e-b1f0-9f6c5bb6c904-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Flow 'volume_create_manager' (5aa2ad3a-2565-4c7a-983f-3f7d06dfdca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92e06c6-b6c4-4dcc-bd6b-b7c4ea08d6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92e06c6-b6c4-4dcc-bd6b-b7c4ea08d6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2127074272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6df2d5-12d8-4b83-a103-039bcbbbbe41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00ac351d0804234a2d55ae3d1698a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:47Z,use_quota=True,user_id='df18845e39a34a5c9af27b333488c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0563acce-bd84-41ab-8814-1a5b2104ceab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0563acce-bd84-41ab-8814-1a5b2104ceab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c4325f-a9e8-4b48-b6da-ede120f127fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c4325f-a9e8-4b48-b6da-ede120f127fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6df2d5-12d8-4b83-a103-039bcbbbbe41', 'volume_name': 'volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8e92a4-b4ed-4738-9fc9-b2db189b79fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8e92a4-b4ed-4738-9fc9-b2db189b79fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86911c74-8423-421e-8567-d7818122b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Volume 0e6df2d5-12d8-4b83-a103-039bcbbbbe41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41', 'volume_size': 1} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2127074272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6df2d5-12d8-4b83-a103-039bcbbbbe41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00ac351d0804234a2d55ae3d1698a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:47Z,use_quota=True,user_id='df18845e39a34a5c9af27b333488c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Creating volume 0e6df2d5-12d8-4b83-a103-039bcbbbbe41 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:47 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:51:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:47 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 1073741824 Jul 11 18:51:47 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:48 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 1073741824" returned: 0 in 0.967s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:48 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 Jul 11 18:51:48 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:49 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41" returned: 0 in 0.819s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86911c74-8423-421e-8567-d7818122b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b73d359-71bf-46e2-a811-c5f416442984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Volume volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 (0e6df2d5-12d8-4b83-a103-039bcbbbbe41): created successfully Jul 11 18:51:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b73d359-71bf-46e2-a811-c5f416442984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Flow 'volume_create_manager' (5aa2ad3a-2565-4c7a-983f-3f7d06dfdca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b16748e7-807d-46bb-a6f1-588b68fd9e21 tempest-VolumesTransfersV357Test-2103455299 None] Created volume successfully. Jul 11 18:51:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-858f9e25-6e6c-485a-b2ca-98cf876bc6f1 tempest-VolumesTransfersV357Test-556467429 None] Transfer volume completed successfully. Jul 11 18:51:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Acquiring lock "cinder-0e6df2d5-12d8-4b83-a103-039bcbbbbe41-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Lock "cinder-0e6df2d5-12d8-4b83-a103-039bcbbbbe41-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Acquiring lock "cinder-quobyte-0e6df2d5-12d8-4b83-a103-039bcbbbbe41" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Lock "cinder-quobyte-0e6df2d5-12d8-4b83-a103-039bcbbbbe41" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ef57d8-5ef1-47e3-9328-341c3832031c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:52 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 Jul 11 18:51:52 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:52 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41" returned: 0 in 0.800s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:52 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41 Jul 11 18:51:52 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:53 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0e6df2d5-12d8-4b83-a103-039bcbbbbe41" returned: 0 in 0.673s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Lock "cinder-quobyte-0e6df2d5-12d8-4b83-a103-039bcbbbbe41" released by "delete_volume" :: held 1.518s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Created reservations ['842e94e0-568c-4e69-93cb-dab12bf036ad', '80b273a8-c5ee-458b-ad4c-3c019a27974b', '66fbd8da-35fc-45a0-832a-99c2712cd8c2', 'eb5fdc5d-db9f-4224-b025-951f6f9d9187'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:53 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:51:53 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:54 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.672s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Deleted volume successfully. Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1fa215d-ef5c-4166-8ada-d3646df51f82 tempest-VolumesTransfersV357Test-1809696169 None] Lock "cinder-0e6df2d5-12d8-4b83-a103-039bcbbbbe41-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Flow 'volume_create_manager' (a8895a25-7079-4e32-8a72-ac9e48a32e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67468c1c-7bf0-4ba4-bf25-f8e092d837e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67468c1c-7bf0-4ba4-bf25-f8e092d837e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1322383850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a459fdef-b57b-48da-963c-2077595c457b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00ac351d0804234a2d55ae3d1698a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:55Z,use_quota=True,user_id='df18845e39a34a5c9af27b333488c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c760d882-03fd-4f8f-8943-a97c0fb7a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c760d882-03fd-4f8f-8943-a97c0fb7a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac57e49-21ec-4ec8-a32e-44eae270865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac57e49-21ec-4ec8-a32e-44eae270865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a459fdef-b57b-48da-963c-2077595c457b', 'volume_name': 'volume-a459fdef-b57b-48da-963c-2077595c457b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d77c4e-4c97-41a7-a495-90210218d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d77c4e-4c97-41a7-a495-90210218d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b31870-b751-445e-b774-55c9c3a16b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:54 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Volume a459fdef-b57b-48da-963c-2077595c457b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a459fdef-b57b-48da-963c-2077595c457b', 'volume_size': 1} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1322383850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a459fdef-b57b-48da-963c-2077595c457b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00ac351d0804234a2d55ae3d1698a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:55Z,use_quota=True,user_id='df18845e39a34a5c9af27b333488c7b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Creating volume a459fdef-b57b-48da-963c-2077595c457b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:54 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:51:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:55 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b 1073741824 Jul 11 18:51:55 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:55 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b 1073741824" returned: 0 in 0.877s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:55 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b Jul 11 18:51:55 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:56 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b" returned: 0 in 0.654s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b31870-b751-445e-b774-55c9c3a16b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a459fdef-b57b-48da-963c-2077595c457b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c7a2bd-655c-415a-b67f-fc46d9730384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Volume volume-a459fdef-b57b-48da-963c-2077595c457b (a459fdef-b57b-48da-963c-2077595c457b): created successfully Jul 11 18:51:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c7a2bd-655c-415a-b67f-fc46d9730384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Flow 'volume_create_manager' (a8895a25-7079-4e32-8a72-ac9e48a32e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-38464a43-7378-4d41-9f6f-09ec1e8c5f13 tempest-VolumesTransfersV357Test-2103455299 None] Created volume successfully. Jul 11 18:51:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Acquiring lock "cinder-a459fdef-b57b-48da-963c-2077595c457b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Lock "cinder-a459fdef-b57b-48da-963c-2077595c457b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Acquiring lock "cinder-quobyte-a459fdef-b57b-48da-963c-2077595c457b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Lock "cinder-quobyte-a459fdef-b57b-48da-963c-2077595c457b" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2813ccf-6f74-45b2-af4d-991f6ec9f4fb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:57 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b Jul 11 18:51:57 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:58 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b" returned: 0 in 0.820s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:58 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b Jul 11 18:51:58 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:58 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a459fdef-b57b-48da-963c-2077595c457b" returned: 0 in 0.655s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Lock "cinder-quobyte-a459fdef-b57b-48da-963c-2077595c457b" released by "delete_volume" :: held 1.516s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Created reservations ['33e56f2c-cb9e-495a-bfab-da20a6635d7c', '5bfd1ce5-6888-4153-864a-9c202836a1ac', '6afbb7b2-57b7-4b97-8c7d-c4db066bb3b6', '9da718ab-3047-4d9b-8a7c-5fc9c8d58538'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:59 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:51:59 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:59 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.745s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:59 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Deleted volume successfully. Jul 11 18:51:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b5cd415a-2857-4a46-9c00-53c737dcb666 tempest-VolumesTransfersV357Test-1809696169 None] Lock "cinder-a459fdef-b57b-48da-963c-2077595c457b-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:DELETE=10,cinder:UPDATE=79,cinder:SELECT=62,cinder:INSERT=17 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=93,cinder:SELECT=62,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Flow 'volume_create_manager' (c70054e3-57c4-4f8a-a0a4-2c2901d83ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a056083-3eee-41cd-9186-f39084ca1440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a056083-3eee-41cd-9186-f39084ca1440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1079200492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fbe258-f176-41cb-a550-1332800716f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ee30d7e8cff4d7ab32331783643692f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:05Z,use_quota=True,user_id='df95b69ebc05486fadf44c4cbe0aaa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0694236-c62f-4932-a960-d86430730656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0694236-c62f-4932-a960-d86430730656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2918f32e-f6f1-4c85-a9e7-bf806b820ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2918f32e-f6f1-4c85-a9e7-bf806b820ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03fbe258-f176-41cb-a550-1332800716f9', 'volume_name': 'volume-03fbe258-f176-41cb-a550-1332800716f9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205f29c5-aeb3-41b7-bde9-c59fc2e93e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205f29c5-aeb3-41b7-bde9-c59fc2e93e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada628fa-a52d-4d97-9962-076ba720f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Volume 03fbe258-f176-41cb-a550-1332800716f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03fbe258-f176-41cb-a550-1332800716f9', 'volume_size': 1} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1079200492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fbe258-f176-41cb-a550-1332800716f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ee30d7e8cff4d7ab32331783643692f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:05Z,use_quota=True,user_id='df95b69ebc05486fadf44c4cbe0aaa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Creating volume 03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:52:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:52:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:04 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 1073741824 Jul 11 18:52:04 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:06 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 1073741824" returned: 0 in 1.152s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:06 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 Jul 11 18:52:06 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:06 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9" returned: 0 in 0.683s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada628fa-a52d-4d97-9962-076ba720f42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03fbe258-f176-41cb-a550-1332800716f9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62dfa50-3ad7-440b-b8c0-b662fe5c15b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Volume volume-03fbe258-f176-41cb-a550-1332800716f9 (03fbe258-f176-41cb-a550-1332800716f9): created successfully Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62dfa50-3ad7-440b-b8c0-b662fe5c15b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Flow 'volume_create_manager' (c70054e3-57c4-4f8a-a0a4-2c2901d83ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d304ee02-167a-4032-811a-c6b5eabd9e61 tempest-VolumesCloneTest-846902065 None] Created volume successfully. Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Flow 'volume_create_manager' (025c01a1-380b-4b4b-bb04-d9ab4d782f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2539a5-2b58-44da-9872-42d2ebadfb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2539a5-2b58-44da-9872-42d2ebadfb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1361318455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334451f7-12a2-454e-b9ca-dc379f6e4a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ee30d7e8cff4d7ab32331783643692f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=03fbe258-f176-41cb-a550-1332800716f9,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:09Z,use_quota=True,user_id='df95b69ebc05486fadf44c4cbe0aaa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac331144-e3b8-492f-bc4b-e9c6c763b9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac331144-e3b8-492f-bc4b-e9c6c763b9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afe8d3f-e670-4364-ac8f-7301e7873b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afe8d3f-e670-4364-ac8f-7301e7873b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '334451f7-12a2-454e-b9ca-dc379f6e4a3b', 'volume_name': 'volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b', 'volume_size': 2, 'source_volid': '03fbe258-f176-41cb-a550-1332800716f9', 'source_volstatus': 'available'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03f67ca-67cd-4c74-ad4a-ad146bf9cef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03f67ca-67cd-4c74-ad4a-ad146bf9cef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c1664f-a4ba-49b5-a83c-c75a28a2aceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Volume 334451f7-12a2-454e-b9ca-dc379f6e4a3b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b', 'volume_size': 2, 'source_volid': '03fbe258-f176-41cb-a550-1332800716f9', 'source_volstatus': 'available'} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:08 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Cloning volume 03fbe258-f176-41cb-a550-1332800716f9 to volume 334451f7-12a2-454e-b9ca-dc379f6e4a3b Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Creating offline snapshot 7cc1316f-a6e3-4d6e-978c-d2f9b689b21b of volume 03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a39adc-cc43-4a13-91f5-3fae9c2f572b]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:08 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 Jul 11 18:52:08 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:09 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9" returned: 0 in 0.806s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:09 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b 1G Jul 11 18:52:09 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:10 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b 1G" returned: 0 in 0.841s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fbe258-f176-41cb-a550-1332800716f9 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:10 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fbe258-f176-41cb-a550-1332800716f9 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b Jul 11 18:52:10 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:11 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fbe258-f176-41cb-a550-1332800716f9 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" returned: 0 in 0.681s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:11 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b is being set with open permissions: ugo+rw Jul 11 18:52:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:11 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b Jul 11 18:52:11 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:11 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" returned: 0 in 0.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:11 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.info Jul 11 18:52:11 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:12 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.info" returned: 0 in 0.669s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:12 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.info is being set with open permissions: ugo+rw Jul 11 18:52:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:12 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.info Jul 11 18:52:12 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:13 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.info" returned: 0 in 0.677s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Acquiring lock "cinder-quobyte-334451f7-12a2-454e-b9ca-dc379f6e4a3b" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Lock "cinder-quobyte-334451f7-12a2-454e-b9ca-dc379f6e4a3b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] snapshot: 7cc1316f-a6e3-4d6e-978c-d2f9b689b21b, volume: 334451f7-12a2-454e-b9ca-dc379f6e4a3b, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9a2150-9e1d-4baf-ab0e-fa156932b69c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-f08f84b8-2e31-4978-8844-8068d8e28501 req-b830d5d1-11fa-47b8-b0c6-57163716e24c tempest-AttachVolumeNegativeTest-1554925873 None] Terminate volume connection completed successfully. Jul 11 18:52:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-f08f84b8-2e31-4978-8844-8068d8e28501 req-b830d5d1-11fa-47b8-b0c6-57163716e24c tempest-AttachVolumeNegativeTest-1554925873 None] Deleting attachment 47332b9d-9e1b-47bb-8bdf-10fa1656e740. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:52:13 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b Jul 11 18:52:13 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:14 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" returned: 0 in 0.817s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03fbe258-f176-41cb-a550-1332800716f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e671fe7-6fef-4330-be4a-f4077e283428]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:14 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 Jul 11 18:52:14 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:14 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9" returned: 0 in 0.838s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:52:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:14 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b Jul 11 18:52:14 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:15 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:52:15 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:15 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.688s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:52:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:52:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8fecc07a-8395-4516-9faf-48cdedf11046 req-1d898b03-fb00-459a-b9c1-4919da9be4d0 tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:21 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b" returned: 0 in 6.237s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0614b9-7c73-4134-910e-16841a16afb2]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:21 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 Jul 11 18:52:21 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:22 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9" returned: 0 in 0.989s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:52:22 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Converted 1024.00 MB image at 164.15 MB/s Jul 11 18:52:22 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b is being set with open permissions: ugo+rw Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:22 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b Jul 11 18:52:22 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:22 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b" returned: 0 in 0.637s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Lock "cinder-quobyte-334451f7-12a2-454e-b9ca-dc379f6e4a3b" released by "_copy_volume_from_snapshot" :: held 9.617s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Acquiring lock "cinder-quobyte-7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Lock "cinder-quobyte-7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Deleting offline snapshot 7cc1316f-a6e3-4d6e-978c-d2f9b689b21b of volume 03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] snapshot_file for this snap is: volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8863412b-19e8-437d-9d77-eb04adfc40e2]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:22 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b Jul 11 18:52:22 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:23 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:52:23 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" returned: 0 in 0.803s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03fbe258-f176-41cb-a550-1332800716f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:52:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d5132-57f0-4c74-8d93-87da9c9dda44]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:23 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 Jul 11 18:52:23 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:24 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9" returned: 0 in 0.798s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:24 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b Jul 11 18:52:24 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:25 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:25 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b Jul 11 18:52:25 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:25 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9.7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Lock "cinder-quobyte-7cc1316f-a6e3-4d6e-978c-d2f9b689b21b" released by "_delete_snapshot" :: held 3.228s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.355s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8fecc07a-8395-4516-9faf-48cdedf11046 req-1d898b03-fb00-459a-b9c1-4919da9be4d0 tempest-TestStampPattern-222445202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.909s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c1664f-a4ba-49b5-a83c-c75a28a2aceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b', 'volume_size': 2, 'source_volid': '03fbe258-f176-41cb-a550-1332800716f9', 'source_volstatus': 'available'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357ee672-95d0-4837-9f34-addbd412498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f813f4-61be-4525-89dd-1d32fb5bd782]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-8fecc07a-8395-4516-9faf-48cdedf11046 req-1d898b03-fb00-459a-b9c1-4919da9be4d0 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Volume volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b (334451f7-12a2-454e-b9ca-dc379f6e4a3b): created successfully Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357ee672-95d0-4837-9f34-addbd412498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Flow 'volume_create_manager' (025c01a1-380b-4b4b-bb04-d9ab4d782f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-79196f1c-e51f-4bae-8ac5-bf91ca5a969a tempest-VolumesCloneTest-846902065 None] Created volume successfully. Jul 11 18:52:26 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 Jul 11 18:52:26 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:26 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-8fecc07a-8395-4516-9faf-48cdedf11046 req-1d898b03-fb00-459a-b9c1-4919da9be4d0 tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75" returned: 0 in 0.801s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8fecc07a-8395-4516-9faf-48cdedf11046 req-1d898b03-fb00-459a-b9c1-4919da9be4d0 tempest-TestStampPattern-222445202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.830s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-8fecc07a-8395-4516-9faf-48cdedf11046 req-1d898b03-fb00-459a-b9c1-4919da9be4d0 tempest-TestStampPattern-222445202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-e46f108b-16ad-4d25-915c-c73a50029f75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d9fe5c2-5b8d-4822-a837-4c3f2d435b3c', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:52:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-8fecc07a-8395-4516-9faf-48cdedf11046 req-1d898b03-fb00-459a-b9c1-4919da9be4d0 tempest-TestStampPattern-222445202 None] attachment_update completed successfully. Jul 11 18:52:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Acquiring lock "cinder-334451f7-12a2-454e-b9ca-dc379f6e4a3b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Lock "cinder-334451f7-12a2-454e-b9ca-dc379f6e4a3b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Acquiring lock "cinder-quobyte-334451f7-12a2-454e-b9ca-dc379f6e4a3b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Lock "cinder-quobyte-334451f7-12a2-454e-b9ca-dc379f6e4a3b" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb07530-caf0-45e5-ba68-ec56e958c622]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:27 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b Jul 11 18:52:27 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:28 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b" returned: 0 in 0.852s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:28 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b Jul 11 18:52:28 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:28 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-334451f7-12a2-454e-b9ca-dc379f6e4a3b" returned: 0 in 0.689s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Lock "cinder-quobyte-334451f7-12a2-454e-b9ca-dc379f6e4a3b" released by "delete_volume" :: held 1.593s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:28 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Created reservations ['a9549147-fedf-47c3-a572-8be5cc8f5e41', '1b011b51-adf8-4c29-81cb-ce6229555e78', 'cb006391-7012-4276-afa1-1e292078985d', '21043a61-fa1e-4bdf-b118-f445f446a16b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:29 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:52:29 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Acquiring lock "cinder-03fbe258-f176-41cb-a550-1332800716f9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Lock "cinder-03fbe258-f176-41cb-a550-1332800716f9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Acquiring lock "cinder-quobyte-03fbe258-f176-41cb-a550-1332800716f9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Lock "cinder-quobyte-03fbe258-f176-41cb-a550-1332800716f9" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[150b0ee0-0161-4a73-9c42-0684c5bbf73f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:29 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.693s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:52:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Deleted volume successfully. Jul 11 18:52:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89980858-0ff8-4418-a739-928648118201 tempest-VolumesCloneTest-846902065 None] Lock "cinder-334451f7-12a2-454e-b9ca-dc379f6e4a3b-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:29 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 Jul 11 18:52:29 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:30 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9" returned: 0 in 0.779s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:30 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9 Jul 11 18:52:30 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:31 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-03fbe258-f176-41cb-a550-1332800716f9" returned: 0 in 0.640s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Lock "cinder-quobyte-03fbe258-f176-41cb-a550-1332800716f9" released by "delete_volume" :: held 1.507s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Created reservations ['6c6d7174-7923-46de-b80e-cbc9b484db2c', '37b22652-43a6-4089-91c7-4d5253259225', '14141eb7-b984-49dc-a81a-375d62d79c3a', 'f0a229d7-5419-4228-97dc-322915135a1a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:31 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:52:31 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:31 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.687s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:31 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:52:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Deleted volume successfully. Jul 11 18:52:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d47006ca-9703-4b8a-88a0-610c9b76a732 tempest-VolumesCloneTest-846902065 None] Lock "cinder-03fbe258-f176-41cb-a550-1332800716f9-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-d9b4feaf-013a-4050-bd85-8332f6ee09d6 req-bfab779e-6ed3-4b3e-9184-4586257b56ed tempest-TestStampPattern-222445202 None] Terminate volume connection completed successfully. Jul 11 18:52:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-d9b4feaf-013a-4050-bd85-8332f6ee09d6 req-bfab779e-6ed3-4b3e-9184-4586257b56ed tempest-TestStampPattern-222445202 None] Deleting attachment 5d9fe5c2-5b8d-4822-a837-4c3f2d435b3c. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Creating offline snapshot e979d9bf-15df-432d-a897-4ede3f8ec03a of volume e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Flow 'volume_create_manager' (e300be52-0172-49a2-9e66-4ba11dac72de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec64a02-e5e0-438d-84cc-e5b81b5d9858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdf78bc-e943-4319-85d2-009549d1cbbb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec64a02-e5e0-438d-84cc-e5b81b5d9858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1337623195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039dfdf3-6a44-4cf3-940e-4a4e3897be14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf8b51a9d6460b9ee56ee4566cf9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:38Z,use_quota=True,user_id='4937f67bed8d42798e1ba2845516d940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d97b9a-2639-481c-8d57-b1a80851777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d97b9a-2639-481c-8d57-b1a80851777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2348ad2e-2801-42b2-b5f3-afd9ed12bcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2348ad2e-2801-42b2-b5f3-afd9ed12bcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '039dfdf3-6a44-4cf3-940e-4a4e3897be14', 'volume_name': 'volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d6e921-9510-420b-9729-9f279a5e5b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d6e921-9510-420b-9729-9f279a5e5b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc5c438-7f92-4ee6-bffc-3dc403693d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Volume 039dfdf3-6a44-4cf3-940e-4a4e3897be14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14', 'volume_size': 1} Jul 11 18:52:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:38 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 Jul 11 18:52:38 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:39 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75" returned: 0 in 0.784s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:39 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a 1G Jul 11 18:52:39 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:40 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a 1G" returned: 0 in 0.979s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46f108b-16ad-4d25-915c-c73a50029f75 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:40 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46f108b-16ad-4d25-915c-c73a50029f75 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a Jul 11 18:52:40 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:40 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46f108b-16ad-4d25-915c-c73a50029f75 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a" returned: 0 in 0.773s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:40 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a is being set with open permissions: ugo+rw Jul 11 18:52:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:40 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a Jul 11 18:52:40 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:41 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a" returned: 0 in 0.684s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:41 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.info Jul 11 18:52:41 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:42 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.info" returned: 0 in 0.663s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:42 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.info is being set with open permissions: ugo+rw Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:42 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.info Jul 11 18:52:42 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:42 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.info" returned: 0 in 0.669s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.692s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.565s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1337623195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039dfdf3-6a44-4cf3-940e-4a4e3897be14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf8b51a9d6460b9ee56ee4566cf9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:38Z,use_quota=True,user_id='4937f67bed8d42798e1ba2845516d940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Creating volume 039dfdf3-6a44-4cf3-940e-4a4e3897be14 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:52:42 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:52:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:42 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 1073741824 Jul 11 18:52:42 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0d6200a1-7db5-4e43-b727-19b9c5adbcbb tempest-TestStampPattern-222445202 None] Create snapshot completed successfully Jul 11 18:52:44 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 1073741824" returned: 0 in 1.159s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:44 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 Jul 11 18:52:44 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:45 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14" returned: 0 in 1.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:52:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.285s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc5c438-7f92-4ee6-bffc-3dc403693d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15364fc2-3c8e-4cff-ac4e-75cb599d5239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Volume volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 (039dfdf3-6a44-4cf3-940e-4a4e3897be14): created successfully Jul 11 18:52:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15364fc2-3c8e-4cff-ac4e-75cb599d5239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Flow 'volume_create_manager' (e300be52-0172-49a2-9e66-4ba11dac72de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3bc0ea60-1d4b-4049-998d-cbcfe358b26c tempest-VolumesListTestJSON-762557861 None] Created volume successfully. Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Flow 'volume_create_manager' (2d855658-395a-4c44-94a8-a02f7b3d57d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626a3215-0dc9-4376-8891-fc9419443fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626a3215-0dc9-4376-8891-fc9419443fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1102462353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07c3eca-ce83-41f7-b4b5-6f3de074977e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf8b51a9d6460b9ee56ee4566cf9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:46Z,use_quota=True,user_id='4937f67bed8d42798e1ba2845516d940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323ade1a-efb3-468e-92fb-f568787cf67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323ade1a-efb3-468e-92fb-f568787cf67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11287f99-e4d3-446d-ba57-b8f44fb7d941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11287f99-e4d3-446d-ba57-b8f44fb7d941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f07c3eca-ce83-41f7-b4b5-6f3de074977e', 'volume_name': 'volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37437b48-e094-4666-8994-8726bc28c091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37437b48-e094-4666-8994-8726bc28c091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a0e815-1abb-400e-b7a4-380130134ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Volume f07c3eca-ce83-41f7-b4b5-6f3de074977e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e', 'volume_size': 1} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1102462353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07c3eca-ce83-41f7-b4b5-6f3de074977e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf8b51a9d6460b9ee56ee4566cf9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:46Z,use_quota=True,user_id='4937f67bed8d42798e1ba2845516d940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Creating volume f07c3eca-ce83-41f7-b4b5-6f3de074977e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:52:46 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:52:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:46 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e 1073741824 Jul 11 18:52:46 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:47 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e 1073741824" returned: 0 in 0.815s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:47 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e Jul 11 18:52:47 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:47 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:52:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a0e815-1abb-400e-b7a4-380130134ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b5c050-7f91-4f7d-a0f9-74b8e0a22b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Volume volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e (f07c3eca-ce83-41f7-b4b5-6f3de074977e): created successfully Jul 11 18:52:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b5c050-7f91-4f7d-a0f9-74b8e0a22b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Flow 'volume_create_manager' (2d855658-395a-4c44-94a8-a02f7b3d57d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a9173dd8-2165-4aec-a17b-54b70fcab819 tempest-VolumesListTestJSON-762557861 None] Created volume successfully. Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Flow 'volume_create_manager' (67fce007-6515-4534-b546-11767f4b7191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb731c5-2ed9-4c90-bd0f-1ab684f8e95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb731c5-2ed9-4c90-bd0f-1ab684f8e95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1326552894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7819f153-b996-44b7-b23b-f720f51ce9b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf8b51a9d6460b9ee56ee4566cf9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:49Z,use_quota=True,user_id='4937f67bed8d42798e1ba2845516d940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90926c7-dadd-43b3-91ab-bccb3b12cdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90926c7-dadd-43b3-91ab-bccb3b12cdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7715559f-20f9-4aa2-b687-39522c22fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7715559f-20f9-4aa2-b687-39522c22fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7819f153-b996-44b7-b23b-f720f51ce9b1', 'volume_name': 'volume-7819f153-b996-44b7-b23b-f720f51ce9b1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6f086e-8005-4adb-975f-73e7038b75b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6f086e-8005-4adb-975f-73e7038b75b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5d2b3e-4e7d-4d88-965d-f8e619ca666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Volume 7819f153-b996-44b7-b23b-f720f51ce9b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7819f153-b996-44b7-b23b-f720f51ce9b1', 'volume_size': 1} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1326552894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7819f153-b996-44b7-b23b-f720f51ce9b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf8b51a9d6460b9ee56ee4566cf9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:49Z,use_quota=True,user_id='4937f67bed8d42798e1ba2845516d940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Creating volume 7819f153-b996-44b7-b23b-f720f51ce9b1 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:52:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:52:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:49 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 1073741824 Jul 11 18:52:49 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:50 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 1073741824" returned: 0 in 0.874s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:50 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 Jul 11 18:52:50 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:50 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1" returned: 0 in 0.667s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5d2b3e-4e7d-4d88-965d-f8e619ca666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7819f153-b996-44b7-b23b-f720f51ce9b1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55937175-2c39-4239-90f3-5bba68b4d530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Volume volume-7819f153-b996-44b7-b23b-f720f51ce9b1 (7819f153-b996-44b7-b23b-f720f51ce9b1): created successfully Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55937175-2c39-4239-90f3-5bba68b4d530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Flow 'volume_create_manager' (67fce007-6515-4534-b546-11767f4b7191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-05a8b453-0e53-4d76-9804-38513bfefb31 tempest-VolumesListTestJSON-762557861 None] Created volume successfully. Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "cinder-7819f153-b996-44b7-b23b-f720f51ce9b1-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-7819f153-b996-44b7-b23b-f720f51ce9b1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Flow 'volume_create_manager' (9993ce08-1e5d-4670-9250-0e40367e7098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4739577f-d5b5-4323-a25e-334c27fe5f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4739577f-d5b5-4323-a25e-334c27fe5f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1351317177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e76863e-4c38-49db-97d6-86406af1dc8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a0112a350447dc8304d12e0690710a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e979d9bf-15df-432d-a897-4ede3f8ec03a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:54Z,use_quota=True,user_id='e472a8899b3f44b89b38361018a32013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9308bcb3-c37b-428c-918e-824fe10099eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9308bcb3-c37b-428c-918e-824fe10099eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc5b7cc-f762-41e5-97ce-f4241fb3ec74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc5b7cc-f762-41e5-97ce-f4241fb3ec74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e76863e-4c38-49db-97d6-86406af1dc8a', 'volume_name': 'volume-5e76863e-4c38-49db-97d6-86406af1dc8a', 'volume_size': 1, 'snapshot_id': 'e979d9bf-15df-432d-a897-4ede3f8ec03a'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bcc35c-2efd-41f4-adb2-67f0593e73a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bcc35c-2efd-41f4-adb2-67f0593e73a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2edb74a-0876-461d-a8d0-52c6a64281ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:53 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Volume 5e76863e-4c38-49db-97d6-86406af1dc8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e76863e-4c38-49db-97d6-86406af1dc8a', 'volume_size': 1, 'snapshot_id': 'e979d9bf-15df-432d-a897-4ede3f8ec03a'} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "cinder-quobyte-7819f153-b996-44b7-b23b-f720f51ce9b1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-quobyte-e979d9bf-15df-432d-a897-4ede3f8ec03a-5e76863e-4c38-49db-97d6-86406af1dc8a" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-quobyte-7819f153-b996-44b7-b23b-f720f51ce9b1" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-e979d9bf-15df-432d-a897-4ede3f8ec03a-5e76863e-4c38-49db-97d6-86406af1dc8a" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Creating volume 5e76863e-4c38-49db-97d6-86406af1dc8a from snapshot e979d9bf-15df-432d-a897-4ede3f8ec03a {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-quobyte-5e76863e-4c38-49db-97d6-86406af1dc8a" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dfcf64-dd52-4296-b1ba-c325138d39f3]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-5e76863e-4c38-49db-97d6-86406af1dc8a" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] snapshot: e979d9bf-15df-432d-a897-4ede3f8ec03a, volume: 5e76863e-4c38-49db-97d6-86406af1dc8a, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:52:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1449a14d-9b1d-4060-a28a-83c0a8070c8e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:54 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 Jul 11 18:52:54 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:54 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a Jul 11 18:52:54 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:55 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1" returned: 0 in 1.093s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:55 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1 Jul 11 18:52:55 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:55 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a" returned: 0 in 1.075s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46f108b-16ad-4d25-915c-c73a50029f75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eefd498-3f91-4840-a6a2-14fc43d88108]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:55 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 Jul 11 18:52:55 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:55 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7819f153-b996-44b7-b23b-f720f51ce9b1" returned: 0 in 0.757s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-quobyte-7819f153-b996-44b7-b23b-f720f51ce9b1" released by "delete_volume" :: held 1.917s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Created reservations ['41b16e65-93fd-4db4-b34e-7ed87c8e32df', '79b8af66-7b64-4f9e-96f4-a05ce7609fff', '3952a1c4-bf44-41e0-9c68-0d773cfd620c', 'a5fa2631-6eec-43c4-be0b-fdd7213528da'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:56 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:52:56 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:56 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75" returned: 0 in 0.902s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "cinder-f07c3eca-ce83-41f7-b4b5-6f3de074977e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:56 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a Jul 11 18:52:56 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-f07c3eca-ce83-41f7-b4b5-6f3de074977e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "cinder-quobyte-f07c3eca-ce83-41f7-b4b5-6f3de074977e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-quobyte-f07c3eca-ce83-41f7-b4b5-6f3de074977e" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b826b03-cb92-491d-82b5-2ad09058ac40]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:56 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e Jul 11 18:52:56 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:56 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.733s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:52:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Deleted volume successfully. Jul 11 18:52:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b10f472-919e-4ca4-a27a-8ed749d25bd2 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-7819f153-b996-44b7-b23b-f720f51ce9b1-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:57 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e" returned: 0 in 0.931s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:57 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e Jul 11 18:52:57 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:58 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f07c3eca-ce83-41f7-b4b5-6f3de074977e" returned: 0 in 1.164s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-quobyte-f07c3eca-ce83-41f7-b4b5-6f3de074977e" released by "delete_volume" :: held 2.158s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Created reservations ['40cf0283-f6fb-4630-ad58-f071ba086cbd', 'f40f59b3-dada-4a7c-a05b-92f5f593960f', 'b2a73d6e-8f8f-4656-9599-00920eb26570', '41a00ebe-7f83-476b-8368-6f10113fbf77'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:58 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:52:58 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "cinder-039dfdf3-6a44-4cf3-940e-4a4e3897be14-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-039dfdf3-6a44-4cf3-940e-4a4e3897be14-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "cinder-quobyte-039dfdf3-6a44-4cf3-940e-4a4e3897be14" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-quobyte-039dfdf3-6a44-4cf3-940e-4a4e3897be14" acquired by "delete_volume" :: waited 0.075s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d33a64f-c921-4c71-9319-33382e2eb392]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:00 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.768s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:00 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Deleted volume successfully. Jul 11 18:53:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-247d156c-aea4-4f53-aee9-795bd2b06e81 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-f07c3eca-ce83-41f7-b4b5-6f3de074977e-delete_volume" released by "delete_volume" :: held 4.394s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:00 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 Jul 11 18:53:00 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:02 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14" returned: 0 in 1.730s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:02 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14 Jul 11 18:53:02 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:02 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a" returned: 0 in 6.188s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[58740126-a892-4ad3-bef9-4ade6ed9848c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:02 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 Jul 11 18:53:02 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:03 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-039dfdf3-6a44-4cf3-940e-4a4e3897be14" returned: 0 in 1.073s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-quobyte-039dfdf3-6a44-4cf3-940e-4a4e3897be14" released by "delete_volume" :: held 2.908s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Created reservations ['f6011f7c-a15f-4afb-a66e-3ab9b0d24657', '5ccb08a4-761d-4114-a12f-ec5c16585043', 'e5666023-a269-4b50-bde7-a7e50147f8c3', '68440515-1d1e-449f-900a-3c523febf183'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:03 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:53:03 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:04 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75" returned: 0 in 1.914s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:04 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:53:04 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Converted 1024.00 MB image at 165.45 MB/s Jul 11 18:53:04 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a is being set with open permissions: ugo+rw Jul 11 18:53:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:04 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a Jul 11 18:53:04 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:04 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.160s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:04 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Deleted volume successfully. Jul 11 18:53:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e84a5bee-d9c0-435f-a711-063a24ceb528 tempest-VolumesListTestJSON-762557861 None] Lock "cinder-039dfdf3-6a44-4cf3-940e-4a4e3897be14-delete_volume" released by "delete_volume" :: held 4.678s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:05 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a" returned: 0 in 1.179s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-5e76863e-4c38-49db-97d6-86406af1dc8a" released by "_copy_volume_from_snapshot" :: held 11.435s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-e979d9bf-15df-432d-a897-4ede3f8ec03a-5e76863e-4c38-49db-97d6-86406af1dc8a" released by "_create_volume_from_snapshot" :: held 11.485s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.524s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=56,cinder:INSERT=11,cinder:UPDATE=62,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2edb74a-0876-461d-a8d0-52c6a64281ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e76863e-4c38-49db-97d6-86406af1dc8a', 'volume_size': 1, 'snapshot_id': 'e979d9bf-15df-432d-a897-4ede3f8ec03a'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46303d26-0c3a-4ef6-9ca7-3803cc8b5df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Volume volume-5e76863e-4c38-49db-97d6-86406af1dc8a (5e76863e-4c38-49db-97d6-86406af1dc8a): created successfully Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46303d26-0c3a-4ef6-9ca7-3803cc8b5df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Flow 'volume_create_manager' (9993ce08-1e5d-4670-9250-0e40367e7098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9735f662-1700-4ba8-86a5-d901d32fe486 tempest-TestStampPattern-222445202 None] Created volume successfully. Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Flow 'volume_create_manager' (7714c6ac-d56c-4eb5-add6-3eac9fde5107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7bed51-3dd8-45e7-9e04-5a074b5cde7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7bed51-3dd8-45e7-9e04-5a074b5cde7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1581621523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8f7fce-548e-4e3a-a01e-0ccb27ee436a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71dba33a61445778249662de6d87eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:06Z,use_quota=True,user_id='cd736ca3222540ff888561ae3e5b7e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb8f832-de60-470c-a297-e3ae989fc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb8f832-de60-470c-a297-e3ae989fc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e943297-ed96-4389-aec2-29c81f8d2de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e943297-ed96-4389-aec2-29c81f8d2de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8f7fce-548e-4e3a-a01e-0ccb27ee436a', 'volume_name': 'volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e808f85-f1aa-430a-8efe-8f03efc67c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e808f85-f1aa-430a-8efe-8f03efc67c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad87a3fc-5478-48dc-bb33-073d0d50e959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Volume da8f7fce-548e-4e3a-a01e-0ccb27ee436a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a', 'volume_size': 1} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1581621523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8f7fce-548e-4e3a-a01e-0ccb27ee436a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71dba33a61445778249662de6d87eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:06Z,use_quota=True,user_id='cd736ca3222540ff888561ae3e5b7e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Creating volume da8f7fce-548e-4e3a-a01e-0ccb27ee436a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:53:06 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:53:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:06 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a 1073741824 Jul 11 18:53:06 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:07 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a 1073741824" returned: 0 in 0.961s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:07 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a Jul 11 18:53:07 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Flow 'volume_create_manager' (25ec4693-f47c-4f8d-8eda-6c21797f433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7065f167-ea06-4290-ba3a-481cec5d3de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7065f167-ea06-4290-ba3a-481cec5d3de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1367350422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049b4696-6e23-4c6a-a19d-d9a3b6e3db6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a384d375dd488f808b05f5016b23d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:08Z,use_quota=True,user_id='e3ad5609c9944097b4b209387a0240fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94950991-d885-42de-aafb-24da4c0e89ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94950991-d885-42de-aafb-24da4c0e89ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36265dae-3e94-41aa-b25b-0493a773d40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36265dae-3e94-41aa-b25b-0493a773d40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049b4696-6e23-4c6a-a19d-d9a3b6e3db6c', 'volume_name': 'volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c', 'volume_size': 2}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542aad05-f504-428b-aca4-4663a5f88695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542aad05-f504-428b-aca4-4663a5f88695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83ff9cb-245f-4812-b340-dc0db2d5d4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Volume 049b4696-6e23-4c6a-a19d-d9a3b6e3db6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c', 'volume_size': 2} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:07 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a" returned: 0 in 0.687s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.066s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1367350422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049b4696-6e23-4c6a-a19d-d9a3b6e3db6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a384d375dd488f808b05f5016b23d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:08Z,use_quota=True,user_id='e3ad5609c9944097b4b209387a0240fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Creating volume 049b4696-6e23-4c6a-a19d-d9a3b6e3db6c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:53:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:53:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c 2147483648 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad87a3fc-5478-48dc-bb33-073d0d50e959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:08 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c 2147483648 Jul 11 18:53:08 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64164ef7-1e48-4e38-955c-a74958f7e60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Volume volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a (da8f7fce-548e-4e3a-a01e-0ccb27ee436a): created successfully Jul 11 18:53:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64164ef7-1e48-4e38-955c-a74958f7e60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Flow 'volume_create_manager' (7714c6ac-d56c-4eb5-add6-3eac9fde5107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-cd31151a-270b-4a73-a816-eb40dd2b958f tempest-AttachVolumeNegativeTest-1554925873 None] Created volume successfully. Jul 11 18:53:09 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c 2147483648" returned: 0 in 1.142s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:09 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c Jul 11 18:53:09 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:09 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" returned: 0 in 0.650s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83ff9cb-245f-4812-b340-dc0db2d5d4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c', 'volume_size': 2}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1590df5e-4984-446d-bb6c-401a705a49ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Volume volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c (049b4696-6e23-4c6a-a19d-d9a3b6e3db6c): created successfully Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1590df5e-4984-446d-bb6c-401a705a49ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Flow 'volume_create_manager' (25ec4693-f47c-4f8d-8eda-6c21797f433f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-379e5949-bc43-4848-ac72-a4ae38e8c076 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Created volume successfully. Jul 11 18:53:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Creating offline snapshot b2785dd0-80e4-426e-b528-933f63f852ca of volume 049b4696-6e23-4c6a-a19d-d9a3b6e3db6c {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:53:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc46cbae-a915-489e-860e-880e1e8f17d0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-70a78fab-f238-4709-81e6-c83b14f15625 req-fc972d29-32de-41b2-aeab-596a13bb8649 tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:11 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c Jul 11 18:53:11 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:12 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" returned: 0 in 0.887s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca 2G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:12 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca 2G Jul 11 18:53:12 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:13 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca 2G" returned: 0 in 1.011s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:13 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca Jul 11 18:53:13 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:13 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca" returned: 0 in 0.758s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:13 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca is being set with open permissions: ugo+rw Jul 11 18:53:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:13 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca Jul 11 18:53:13 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:14 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca" returned: 0 in 0.670s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:14 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.info Jul 11 18:53:14 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:15 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:53:15 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:15 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.info" returned: 0 in 0.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:15 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.info is being set with open permissions: ugo+rw Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:15 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.info Jul 11 18:53:15 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:15 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.708s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:53:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:53:16 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.info" returned: 0 in 0.700s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.950s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-70a78fab-f238-4709-81e6-c83b14f15625 req-fc972d29-32de-41b2-aeab-596a13bb8649 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.821s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71e5fe-96e9-4ae3-a7d4-8c9ad91d66b1]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-70a78fab-f238-4709-81e6-c83b14f15625 req-fc972d29-32de-41b2-aeab-596a13bb8649 tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d7e5ccd8-42dd-45ce-b9dc-164a64872d55 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Create snapshot completed successfully Jul 11 18:53:16 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a Jul 11 18:53:16 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "cinder-b2785dd0-80e4-426e-b528-933f63f852ca-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-b2785dd0-80e4-426e-b528-933f63f852ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "cinder-quobyte-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-quobyte-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "cinder-quobyte-b2785dd0-80e4-426e-b528-933f63f852ca" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-quobyte-b2785dd0-80e4-426e-b528-933f63f852ca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Deleting offline snapshot b2785dd0-80e4-426e-b528-933f63f852ca of volume 049b4696-6e23-4c6a-a19d-d9a3b6e3db6c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] snapshot_file for this snap is: volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cab41f-23de-4dc1-87f6-e8d4df20fde7]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:16 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca Jul 11 18:53:16 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:17 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-70a78fab-f238-4709-81e6-c83b14f15625 req-fc972d29-32de-41b2-aeab-596a13bb8649 tempest-AttachVolumeNegativeTest-1554925873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a" returned: 0 in 0.819s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-70a78fab-f238-4709-81e6-c83b14f15625 req-fc972d29-32de-41b2-aeab-596a13bb8649 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-70a78fab-f238-4709-81e6-c83b14f15625 req-fc972d29-32de-41b2-aeab-596a13bb8649 tempest-AttachVolumeNegativeTest-1554925873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1ba4c26-f3d0-455a-b2bf-a62bcba105fc', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:53:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-70a78fab-f238-4709-81e6-c83b14f15625 req-fc972d29-32de-41b2-aeab-596a13bb8649 tempest-AttachVolumeNegativeTest-1554925873 None] attachment_update completed successfully. Jul 11 18:53:17 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca" returned: 0 in 0.785s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:53:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dbbefc-59c2-4789-866f-5a273b6b7653]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:17 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c Jul 11 18:53:17 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:18 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" returned: 0 in 0.866s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:18 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca Jul 11 18:53:18 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:19 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca" returned: 0 in 0.794s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:19 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca Jul 11 18:53:19 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:19 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c.b2785dd0-80e4-426e-b528-933f63f852ca" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-quobyte-b2785dd0-80e4-426e-b528-933f63f852ca" released by "_delete_snapshot" :: held 3.207s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-quobyte-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" released by "delete_snapshot" :: held 3.235s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Created reservations ['6ac79817-04af-4579-b7b3-9ad593b32bfa', '3290f276-2292-42ab-8879-671e32907435', '4ed7ab43-2e25-43cc-8674-ddaa2417b16e', '8a6ef64a-4be4-434e-b678-f6db5309f6d8'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Delete snapshot completed successfully. Jul 11 18:53:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c3dbd511-d0bd-43a2-bebb-0079afa57ed5 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-b2785dd0-80e4-426e-b528-933f63f852ca-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "cinder-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "cinder-quobyte-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-quobyte-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9d8e06-c334-493c-b68e-7d963a975657]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:21 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c Jul 11 18:53:21 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:21 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" returned: 0 in 0.825s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:21 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c Jul 11 18:53:21 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:22 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" returned: 0 in 0.711s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-quobyte-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c" released by "delete_volume" :: held 1.618s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Created reservations ['47f8daf3-2a57-42a5-a844-7deb779a6b0d', 'a7ac6577-f663-4ae0-a2ed-57d78ebfd8e2', '887a1b39-f753-4bc8-b179-37a14d07db68', '6732e5c8-e45d-4716-8ac9-5894f8faa343'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:22 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:53:22 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:23 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.644s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:23 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Deleted volume successfully. Jul 11 18:53:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ee8c7e9-28d4-4545-956e-e328d7cc5021 tempest-VolumesSnapshotNegativeTestJSON-444588907 None] Lock "cinder-049b4696-6e23-4c6a-a19d-d9a3b6e3db6c-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:23 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=65,cinder:UPDATE=83,cinder:DELETE=9,cinder:INSERT=20 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:53:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-b69d3a1e-c847-4527-ae84-8d36c961b38d req-5506d3fc-77e8-47b8-91e1-bbb7f4293963 tempest-AttachVolumeNegativeTest-1554925873 None] Terminate volume connection completed successfully. Jul 11 18:53:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-b69d3a1e-c847-4527-ae84-8d36c961b38d req-5506d3fc-77e8-47b8-91e1-bbb7f4293963 tempest-AttachVolumeNegativeTest-1554925873 None] Deleting attachment f1ba4c26-f3d0-455a-b2bf-a62bcba105fc. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:53:33 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=20,cinder:DELETE=3,cinder:SELECT=22,cinder:INSERT=7 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:53:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-456ed4c3-4e4c-4efc-99fb-a1369e7d2ba9 req-ee448f03-c17c-4504-b75b-9d54750712f7 tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-456ed4c3-4e4c-4efc-99fb-a1369e7d2ba9 req-ee448f03-c17c-4504-b75b-9d54750712f7 tempest-TestStampPattern-222445202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dcd1fe-fee0-45c3-b72e-b8b9890a5219]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-456ed4c3-4e4c-4efc-99fb-a1369e7d2ba9 req-ee448f03-c17c-4504-b75b-9d54750712f7 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:40 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a Jul 11 18:53:40 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:41 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-456ed4c3-4e4c-4efc-99fb-a1369e7d2ba9 req-ee448f03-c17c-4504-b75b-9d54750712f7 tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a" returned: 0 in 0.863s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-456ed4c3-4e4c-4efc-99fb-a1369e7d2ba9 req-ee448f03-c17c-4504-b75b-9d54750712f7 tempest-TestStampPattern-222445202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.887s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-456ed4c3-4e4c-4efc-99fb-a1369e7d2ba9 req-ee448f03-c17c-4504-b75b-9d54750712f7 tempest-TestStampPattern-222445202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-5e76863e-4c38-49db-97d6-86406af1dc8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '813e40c7-7506-45b5-b826-714934b16347', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:53:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-456ed4c3-4e4c-4efc-99fb-a1369e7d2ba9 req-ee448f03-c17c-4504-b75b-9d54750712f7 tempest-TestStampPattern-222445202 None] attachment_update completed successfully. Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Flow 'volume_create_manager' (4f52b47e-c04a-4995-b655-ece905e2a33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f87e4a2-8fc7-47e6-8dcb-f12a784e4396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f87e4a2-8fc7-47e6-8dcb-f12a784e4396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1901843462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5f2646-2332-44ca-8260-a8addf779cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99392a5533b4f69ba2882e2eeb13457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:49Z,use_quota=True,user_id='2bf130aaf92740e5aaa5e77c27b8b82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2d8ffc0-8f8c-4ddb-b12e-dcc62c4756ac),volume_type_id=e2d8ffc0-8f8c-4ddb-b12e-dcc62c4756ac)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4542de7-599e-4db4-b441-0f96f4b4ee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4542de7-599e-4db4-b441-0f96f4b4ee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a4aff8-5e47-4467-9e1f-6fba0bb4849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a4aff8-5e47-4467-9e1f-6fba0bb4849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5f2646-2332-44ca-8260-a8addf779cdb', 'volume_name': 'volume-8d5f2646-2332-44ca-8260-a8addf779cdb', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4142e8d3-0527-453c-b9c7-491664f6e0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4142e8d3-0527-453c-b9c7-491664f6e0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385379e9-5d97-4332-ad65-ea62646af1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume 8d5f2646-2332-44ca-8260-a8addf779cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5f2646-2332-44ca-8260-a8addf779cdb', 'volume_size': 1} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1901843462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5f2646-2332-44ca-8260-a8addf779cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99392a5533b4f69ba2882e2eeb13457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:49Z,use_quota=True,user_id='2bf130aaf92740e5aaa5e77c27b8b82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2d8ffc0-8f8c-4ddb-b12e-dcc62c4756ac),volume_type_id=e2d8ffc0-8f8c-4ddb-b12e-dcc62c4756ac)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Creating volume 8d5f2646-2332-44ca-8260-a8addf779cdb {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:53:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:49 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb 1073741824 Jul 11 18:53:49 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-a189deba-dd39-4705-a750-8cce1a66bea8 req-6bb74129-7ef3-4aeb-9afb-a2b6fbd78b45 tempest-TestStampPattern-222445202 None] Terminate volume connection completed successfully. Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a189deba-dd39-4705-a750-8cce1a66bea8 req-6bb74129-7ef3-4aeb-9afb-a2b6fbd78b45 tempest-TestStampPattern-222445202 None] Deleting attachment 813e40c7-7506-45b5-b826-714934b16347. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Flow 'volume_create_manager' (3854424f-b5d8-48b6-8b65-b3c51929d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a795c-f92b-4749-af1c-c59815265902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a795c-f92b-4749-af1c-c59815265902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1104042643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0b9656-e802-482b-b6c7-638b3dc2e09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99392a5533b4f69ba2882e2eeb13457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:50Z,use_quota=True,user_id='2bf130aaf92740e5aaa5e77c27b8b82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e7595f2-099b-4298-ae20-5054196e27f3),volume_type_id=3e7595f2-099b-4298-ae20-5054196e27f3)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a41790f-094a-4b6d-b8a0-39342b9efdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a41790f-094a-4b6d-b8a0-39342b9efdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f94e115-47a0-46d4-b7d1-80bcc1d6a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f94e115-47a0-46d4-b7d1-80bcc1d6a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0b9656-e802-482b-b6c7-638b3dc2e09c', 'volume_name': 'volume-be0b9656-e802-482b-b6c7-638b3dc2e09c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bdce88-de0a-4312-a044-fbd8149be7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bdce88-de0a-4312-a044-fbd8149be7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501250b5-8837-4d15-b510-c6b2380bf81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume be0b9656-e802-482b-b6c7-638b3dc2e09c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0b9656-e802-482b-b6c7-638b3dc2e09c', 'volume_size': 1} Jul 11 18:53:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:50 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Flow 'volume_create_manager' (60475be7-8052-4487-9d7e-e30d24f7e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277082ab-e1e4-458f-b44e-97bf5842e1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb 1073741824" returned: 0 in 1.329s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277082ab-e1e4-458f-b44e-97bf5842e1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2013332531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cfdb4f-c140-4060-926c-0fcc1ad75467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99392a5533b4f69ba2882e2eeb13457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:51Z,use_quota=True,user_id='2bf130aaf92740e5aaa5e77c27b8b82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09c9e0e0-a93a-42ec-a246-5e20a659805f),volume_type_id=09c9e0e0-a93a-42ec-a246-5e20a659805f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9f1b81-9c8f-474c-aa30-104c932da622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9f1b81-9c8f-474c-aa30-104c932da622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0644688-325f-4ede-b22d-f5a41da8a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:53:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:50 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb Jul 11 18:53:50 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0644688-325f-4ede-b22d-f5a41da8a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5cfdb4f-c140-4060-926c-0fcc1ad75467', 'volume_name': 'volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467', 'volume_size': 1, 'image_id': 'b69639cd-faa1-47e4-a792-d7f8712c7c98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69639cd-faa1-47e4-a792-d7f8712c7c98', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--465123727', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e99392a5533b4f69ba2882e2eeb13457', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69639cd-faa1-47e4-a792-d7f8712c7c98', 'created_at': datetime.datetime(2026, 7, 11, 16, 53, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69639cd-faa1-47e4-a792-d7f8712c7c98/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b714e512-33d7-44f2-8866-328195647261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b714e512-33d7-44f2-8866-328195647261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a9598-9c19-4c71-986f-2d8ea40ca073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume b5cfdb4f-c140-4060-926c-0fcc1ad75467: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467', 'volume_size': 1, 'image_id': 'b69639cd-faa1-47e4-a792-d7f8712c7c98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69639cd-faa1-47e4-a792-d7f8712c7c98', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--465123727', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e99392a5533b4f69ba2882e2eeb13457', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69639cd-faa1-47e4-a792-d7f8712c7c98', 'created_at': datetime.datetime(2026, 7, 11, 16, 53, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69639cd-faa1-47e4-a792-d7f8712c7c98/file', 'properties': {}}, 'image_service': } Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Trying to clone b5cfdb4f-c140-4060-926c-0fcc1ad75467 from image b69639cd-faa1-47e4-a792-d7f8712c7c98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b69639cd-faa1-47e4-a792-d7f8712c7c98', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:53:51 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb" returned: 0 in 0.842s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.842s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1104042643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0b9656-e802-482b-b6c7-638b3dc2e09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99392a5533b4f69ba2882e2eeb13457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:50Z,use_quota=True,user_id='2bf130aaf92740e5aaa5e77c27b8b82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e7595f2-099b-4298-ae20-5054196e27f3),volume_type_id=3e7595f2-099b-4298-ae20-5054196e27f3)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Creating volume be0b9656-e802-482b-b6c7-638b3dc2e09c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:53:51 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:51 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c 1073741824 Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385379e9-5d97-4332-ad65-ea62646af1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5f2646-2332-44ca-8260-a8addf779cdb', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:51 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79fd8db-e91f-40d5-aa76-fdf6a318848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume volume-8d5f2646-2332-44ca-8260-a8addf779cdb (8d5f2646-2332-44ca-8260-a8addf779cdb): created successfully Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79fd8db-e91f-40d5-aa76-fdf6a318848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Flow 'volume_create_manager' (4f52b47e-c04a-4995-b655-ece905e2a33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e0d538b1-315e-433c-bcdf-abcd3b3baaa9 tempest-TestInstancesWithCinderVolumes-1239825512 None] Created volume successfully. Jul 11 18:53:52 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c 1073741824" returned: 0 in 1.293s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:53 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c Jul 11 18:53:53 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:53 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c" returned: 0 in 0.993s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] <== create_volume: return (2343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:53:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501250b5-8837-4d15-b510-c6b2380bf81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0b9656-e802-482b-b6c7-638b3dc2e09c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b9f691-bfef-461d-b428-7c6f54b12c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:54 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume volume-be0b9656-e802-482b-b6c7-638b3dc2e09c (be0b9656-e802-482b-b6c7-638b3dc2e09c): created successfully Jul 11 18:53:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b9f691-bfef-461d-b428-7c6f54b12c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Flow 'volume_create_manager' (3854424f-b5d8-48b6-8b65-b3c51929d179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-38158d0c-f46f-4d89-b66a-e99814f545ff tempest-TestInstancesWithCinderVolumes-1239825512 None] Created volume successfully. Jul 11 18:53:56 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD, size 20.69 MB, duration 5.23 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:53:56 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Image download 20.69 MB at 3.95 MB/s Jul 11 18:53:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[af991d59-f940-471b-9286-3c06adf0ca3d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:56 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD Jul 11 18:53:56 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:57 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD" returned: 0 in 0.951s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:57 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Temporary image b69639cd-faa1-47e4-a792-d7f8712c7c98 is fetched for user 2bf130aaf92740e5aaa5e77c27b8b82c. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:53:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aad20e-e9db-46a4-9f24-f5f031ea73ad]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:57 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD Jul 11 18:53:57 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:58 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD" returned: 0 in 0.805s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2013332531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cfdb4f-c140-4060-926c-0fcc1ad75467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99392a5533b4f69ba2882e2eeb13457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:51Z,use_quota=True,user_id='2bf130aaf92740e5aaa5e77c27b8b82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09c9e0e0-a93a-42ec-a246-5e20a659805f),volume_type_id=09c9e0e0-a93a-42ec-a246-5e20a659805f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Creating volume b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:53:58 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:53:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:58 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 1073741824 Jul 11 18:53:58 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:59 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 1073741824" returned: 0 in 0.890s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:59 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:53:59 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-5e76863e-4c38-49db-97d6-86406af1dc8a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Lock "cinder-5e76863e-4c38-49db-97d6-86406af1dc8a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-quobyte-5e76863e-4c38-49db-97d6-86406af1dc8a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-5e76863e-4c38-49db-97d6-86406af1dc8a" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[839a3a9a-7217-4e83-90f6-b559e1aae6b0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:59 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a Jul 11 18:53:59 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:59 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 0 in 0.701s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:59 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Attempting download of b69639cd-faa1-47e4-a792-d7f8712c7c98 ((None, [{'url': 'file:///opt/stack/data/glance/images/b69639cd-faa1-47e4-a792-d7f8712c7c98', 'metadata': {}}])) to volume b5cfdb4f-c140-4060-926c-0fcc1ad75467. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:54:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a87936-f28e-4da2-bb7c-571f1bf5c2c5]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69639cd-faa1-47e4-a792-d7f8712c7c98_rcou4q5e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:00 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69639cd-faa1-47e4-a792-d7f8712c7c98_rcou4q5e Jul 11 18:54:00 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:00 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a" returned: 0 in 0.766s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:00 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a Jul 11 18:54:00 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:00 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69639cd-faa1-47e4-a792-d7f8712c7c98_rcou4q5e" returned: 0 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69639cd-faa1-47e4-a792-d7f8712c7c98_rcou4q5e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:00 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69639cd-faa1-47e4-a792-d7f8712c7c98_rcou4q5e Jul 11 18:54:00 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:01 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5e76863e-4c38-49db-97d6-86406af1dc8a" returned: 0 in 0.667s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-5e76863e-4c38-49db-97d6-86406af1dc8a" released by "delete_volume" :: held 1.485s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Created reservations ['e1ee2983-3da7-43c4-bc82-b10f605d5c08', '60e53a05-915d-4e91-9e95-d56546382ba5', '43cad29a-04e1-4ded-bc4d-d9b67f0b4ac0', 'f6305844-bba3-4721-a88e-b78c48c3cab6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:01 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:54:01 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:01 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69639cd-faa1-47e4-a792-d7f8712c7c98_rcou4q5e" returned: 1 in 0.749s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69639cd-faa1-47e4-a792-d7f8712c7c98_rcou4q5e' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a0bd45-bf45-4637-a2ed-c97db8e9d31b]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:01 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD Jul 11 18:54:01 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:02 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.730s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Deleted volume successfully. Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1d86a166-ad8c-4722-84a8-2456923abae8 tempest-TestStampPattern-222445202 None] Lock "cinder-5e76863e-4c38-49db-97d6-86406af1dc8a-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-e979d9bf-15df-432d-a897-4ede3f8ec03a-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Lock "cinder-e979d9bf-15df-432d-a897-4ede3f8ec03a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-quobyte-e46f108b-16ad-4d25-915c-c73a50029f75" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-e46f108b-16ad-4d25-915c-c73a50029f75" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-quobyte-e979d9bf-15df-432d-a897-4ede3f8ec03a" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-e979d9bf-15df-432d-a897-4ede3f8ec03a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Deleting offline snapshot e979d9bf-15df-432d-a897-4ede3f8ec03a of volume e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] snapshot_file for this snap is: volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[973a2d5c-ea47-4b20-ae2e-411c936dd23c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:02 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD" returned: 0 in 0.848s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] b69639cd-faa1-47e4-a792-d7f8712c7c98 was qcow2, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:54:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:02 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:54:02 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:02 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a Jul 11 18:54:02 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:03 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a" returned: 0 in 0.785s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46f108b-16ad-4d25-915c-c73a50029f75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:54:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7981eaa-a4ac-4b5d-ac6c-076e23761004]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:03 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 Jul 11 18:54:03 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:04 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75" returned: 0 in 0.904s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:04 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a Jul 11 18:54:04 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:04 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 0 in 1.956s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:04 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b69639cd-faa1-47e4-a792-d7f8712c7c98__4t_6ou4devstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:54:04 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Converted 112.00 MB image at 57.22 MB/s Jul 11 18:54:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:04 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 1G Jul 11 18:54:04 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:04 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a" returned: 0 in 0.775s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:04 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a Jul 11 18:54:04 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:05 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 1G" returned: 0 in 0.780s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[785523bf-cede-4452-a069-2e595e16c3af]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:05 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:54:05 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:05 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75.e979d9bf-15df-432d-a897-4ede3f8ec03a" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-e979d9bf-15df-432d-a897-4ede3f8ec03a" released by "_delete_snapshot" :: held 3.254s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-e46f108b-16ad-4d25-915c-c73a50029f75" released by "delete_snapshot" :: held 3.285s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Created reservations ['82cc911a-ecf7-4dd7-8cd6-8754ec9c3c94', '721649ea-3b41-45ec-b4e9-a57501ba2e1a', '91c35d6d-8347-44d6-958e-9c7770d3a091', '343ab7c1-b721-490b-add8-0ebd12a91c0b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Delete snapshot completed successfully. Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c914c727-d197-4d36-b532-adfa94d8d8c8 tempest-TestStampPattern-222445202 None] Lock "cinder-e979d9bf-15df-432d-a897-4ede3f8ec03a-delete_snapshot" released by "delete_snapshot" :: held 3.434s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:05 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 0 in 0.797s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:06 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:54:06 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:06 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 1 in 0.780s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Downloaded image b69639cd-faa1-47e4-a792-d7f8712c7c98 ((None, [{'url': 'file:///opt/stack/data/glance/images/b69639cd-faa1-47e4-a792-d7f8712c7c98', 'metadata': {}}])) to volume b5cfdb4f-c140-4060-926c-0fcc1ad75467 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Temporary image b69639cd-faa1-47e4-a792-d7f8712c7c98 for user 2bf130aaf92740e5aaa5e77c27b8b82c is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Marking volume b5cfdb4f-c140-4060-926c-0fcc1ad75467 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Copying metadata from image b69639cd-faa1-47e4-a792-d7f8712c7c98 to b5cfdb4f-c140-4060-926c-0fcc1ad75467. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Creating volume glance metadata for volume b5cfdb4f-c140-4060-926c-0fcc1ad75467 backed by image b69639cd-faa1-47e4-a792-d7f8712c7c98 with: {'image_id': 'b69639cd-faa1-47e4-a792-d7f8712c7c98', 'image_name': 'tempest-scenario-img--465123727', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a9598-9c19-4c71-986f-2d8ea40ca073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467', 'volume_size': 1, 'image_id': 'b69639cd-faa1-47e4-a792-d7f8712c7c98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69639cd-faa1-47e4-a792-d7f8712c7c98', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--465123727', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e99392a5533b4f69ba2882e2eeb13457', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69639cd-faa1-47e4-a792-d7f8712c7c98', 'created_at': datetime.datetime(2026, 7, 11, 16, 53, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69639cd-faa1-47e4-a792-d7f8712c7c98/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35efd7ba-6028-4e8e-8cab-ed1e4a63dda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Volume volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 (b5cfdb4f-c140-4060-926c-0fcc1ad75467): created successfully Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35efd7ba-6028-4e8e-8cab-ed1e4a63dda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Flow 'volume_create_manager' (60475be7-8052-4487-9d7e-e30d24f7e70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b7d7c745-92dd-459c-8af3-3f6de522cb21 tempest-TestInstancesWithCinderVolumes-1239825512 None] Created volume successfully. Jul 11 18:54:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-e46f108b-16ad-4d25-915c-c73a50029f75-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Lock "cinder-e46f108b-16ad-4d25-915c-c73a50029f75-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Acquiring lock "cinder-quobyte-e46f108b-16ad-4d25-915c-c73a50029f75" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-e46f108b-16ad-4d25-915c-c73a50029f75" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcd7c86-7fb1-4931-bec2-c300ca82adfb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:15 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 Jul 11 18:54:15 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:15 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:54:15 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed67059-3d6d-4215-a731-a851c5fafd44]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:15 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:54:15 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:15 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:54:15 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75" returned: 0 in 0.931s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:15 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75 Jul 11 18:54:15 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:16 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 0 in 0.847s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:16 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:54:16 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:16 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e46f108b-16ad-4d25-915c-c73a50029f75" returned: 0 in 0.727s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Lock "cinder-quobyte-e46f108b-16ad-4d25-915c-c73a50029f75" released by "delete_volume" :: held 1.764s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Created reservations ['8fbb0480-59a7-4e6a-afbb-b58eeaa3a2b0', '44f4e631-848a-4d3b-97f1-d85bbd049008', '1f5d02ac-e2ec-4af4-ba09-8206b8084e03', '506e7830-0d78-4a40-8eed-94ad42bc9052'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:16 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:54:16 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:16 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 1 in 0.847s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.762s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20975662-6da2-4172-9d1f-b1a2cfec320b', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:54:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-b30fec69-8689-4165-8a2a-7730f680274d req-2ee59851-d64c-4432-b474-0d7ba2c98696 tempest-TestInstancesWithCinderVolumes-1239825512 None] attachment_update completed successfully. Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Flow 'volume_create_manager' (6ef74287-1eb6-4ced-bc56-a5d287c3d0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39f2eb1-c61b-49da-b507-9d3d28fee127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39f2eb1-c61b-49da-b507-9d3d28fee127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-607659033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71dba33a61445778249662de6d87eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:17Z,use_quota=True,user_id='cd736ca3222540ff888561ae3e5b7e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a9927e-7d90-4cad-8f39-1e3b7a4cb68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a9927e-7d90-4cad-8f39-1e3b7a4cb68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a82f35-7bb0-4b95-a8a3-47fdcb3d5cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a82f35-7bb0-4b95-a8a3-47fdcb3d5cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f', 'volume_name': 'volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5eeddb-aea0-413a-930d-c1d2ff0074b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5eeddb-aea0-413a-930d-c1d2ff0074b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6c3f2d-6623-4e84-b6cb-fc6d73f32e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Volume fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f', 'volume_size': 1} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-607659033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71dba33a61445778249662de6d87eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:17Z,use_quota=True,user_id='cd736ca3222540ff888561ae3e5b7e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Creating volume fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:17 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:17 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f 1073741824 Jul 11 18:54:17 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:17 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.932s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Deleted volume successfully. Jul 11 18:54:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d27cef16-4658-4516-83e7-aaa60db4e83d tempest-TestStampPattern-222445202 None] Lock "cinder-e46f108b-16ad-4d25-915c-c73a50029f75-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:18 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f 1073741824" returned: 0 in 1.000s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:18 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f Jul 11 18:54:18 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:19 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f" returned: 0 in 0.735s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6c3f2d-6623-4e84-b6cb-fc6d73f32e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2a4c49-a974-48e0-b98f-c0546fd467a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:19 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Volume volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f (fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f): created successfully Jul 11 18:54:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2a4c49-a974-48e0-b98f-c0546fd467a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Flow 'volume_create_manager' (6ef74287-1eb6-4ced-bc56-a5d287c3d0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-aedd3e40-6f06-44f8-8c36-dd1125578e3c tempest-AttachVolumeNegativeTest-1554925873 None] Created volume successfully. Jul 11 18:54:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-0d779301-4849-4c4d-887a-9d0095d9faa7 req-333e6c02-9353-4bf3-bc94-250bad174773 tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-0d779301-4849-4c4d-887a-9d0095d9faa7 req-333e6c02-9353-4bf3-bc94-250bad174773 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4622c535-41d8-4ab6-9a7b-eaf4dc552a41]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-0d779301-4849-4c4d-887a-9d0095d9faa7 req-333e6c02-9353-4bf3-bc94-250bad174773 tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:23 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f Jul 11 18:54:23 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:23 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-0d779301-4849-4c4d-887a-9d0095d9faa7 req-333e6c02-9353-4bf3-bc94-250bad174773 tempest-AttachVolumeNegativeTest-1554925873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f" returned: 0 in 0.975s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-0d779301-4849-4c4d-887a-9d0095d9faa7 req-333e6c02-9353-4bf3-bc94-250bad174773 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-0d779301-4849-4c4d-887a-9d0095d9faa7 req-333e6c02-9353-4bf3-bc94-250bad174773 tempest-AttachVolumeNegativeTest-1554925873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70b4f212-c3d9-4ae6-afb3-c185440dae0a', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:54:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-0d779301-4849-4c4d-887a-9d0095d9faa7 req-333e6c02-9353-4bf3-bc94-250bad174773 tempest-AttachVolumeNegativeTest-1554925873 None] attachment_update completed successfully. Jul 11 18:54:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-bf9c52ad-601e-4af9-b13f-9cc35f3ddf78 req-490d19b5-f183-41a1-b4df-9a99c1055661 tempest-AttachVolumeNegativeTest-1554925873 None] Terminate volume connection completed successfully. Jul 11 18:54:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-bf9c52ad-601e-4af9-b13f-9cc35f3ddf78 req-490d19b5-f183-41a1-b4df-9a99c1055661 tempest-AttachVolumeNegativeTest-1554925873 None] Deleting attachment 70b4f212-c3d9-4ae6-afb3-c185440dae0a. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=52,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=44,cinder:UPDATE=41,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Flow 'volume_create_manager' (b2dfe16e-bd6e-49c2-bbf8-55a86bf07d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03060db-7fc2-4281-940c-eddf21f3142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03060db-7fc2-4281-940c-eddf21f3142e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f376ef70-23bf-4f2e-aa48-1fa0a850e574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec972c7288d4178903ebc60086a5760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:36Z,use_quota=True,user_id='32c133ea72064618ad05b0c891924962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed4854f7-757a-4236-94f1-f355be098ff8),volume_type_id=ed4854f7-757a-4236-94f1-f355be098ff8)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c217dc-7646-4433-bf9b-9ee68446d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c217dc-7646-4433-bf9b-9ee68446d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c0f549-8b8b-437a-9243-af57a4c93650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c0f549-8b8b-437a-9243-af57a4c93650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f376ef70-23bf-4f2e-aa48-1fa0a850e574', 'volume_name': 'volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574', 'volume_size': 1, 'image_id': '123abfe4-94f5-4201-89d9-ca5713751636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/123abfe4-94f5-4201-89d9-ca5713751636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673350ea9d5f6feac1b7195254e7c54d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fec972c7288d4178903ebc60086a5760', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88e90c954d02abd5aa4708ce98770a1e8d61ca839be0c769bcb2a96b07533113f3ce6bfdd9594d62238ef65b32c95b257e8067d1dd0987b8ab89494f8966a0cd', 'id': '123abfe4-94f5-4201-89d9-ca5713751636', 'created_at': datetime.datetime(2026, 7, 11, 16, 54, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 54, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/123abfe4-94f5-4201-89d9-ca5713751636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce96fcb0-abbd-4010-a4d2-c75bd88aad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce96fcb0-abbd-4010-a4d2-c75bd88aad93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868aaadc-5342-4b17-bd52-8d73c84d51fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Volume f376ef70-23bf-4f2e-aa48-1fa0a850e574: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574', 'volume_size': 1, 'image_id': '123abfe4-94f5-4201-89d9-ca5713751636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/123abfe4-94f5-4201-89d9-ca5713751636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673350ea9d5f6feac1b7195254e7c54d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fec972c7288d4178903ebc60086a5760', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88e90c954d02abd5aa4708ce98770a1e8d61ca839be0c769bcb2a96b07533113f3ce6bfdd9594d62238ef65b32c95b257e8067d1dd0987b8ab89494f8966a0cd', 'id': '123abfe4-94f5-4201-89d9-ca5713751636', 'created_at': datetime.datetime(2026, 7, 11, 16, 54, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 54, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/123abfe4-94f5-4201-89d9-ca5713751636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Trying to clone f376ef70-23bf-4f2e-aa48-1fa0a850e574 from image 123abfe4-94f5-4201-89d9-ca5713751636 at location (None, [{'url': 'file:///opt/stack/data/glance/images/123abfe4-94f5-4201-89d9-ca5713751636', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:54:36 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Image download 0.00 MB at 0.00 MB/s Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fefed0-32c6-4dc2-b64f-2abb560f3d5a]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:36 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD Jul 11 18:54:36 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:37 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD" returned: 0 in 0.840s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:37 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD Jul 11 18:54:37 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:38 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:38 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Temporary image 123abfe4-94f5-4201-89d9-ca5713751636 is fetched for user 32c133ea72064618ad05b0c891924962. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:54:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8596ef3-7d82-4d29-afb4-32a9dd857932]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:38 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD Jul 11 18:54:38 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:39 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:39 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD Jul 11 18:54:39 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:40 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD" returned: 1 in 0.793s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f376ef70-23bf-4f2e-aa48-1fa0a850e574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec972c7288d4178903ebc60086a5760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:36Z,use_quota=True,user_id='32c133ea72064618ad05b0c891924962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed4854f7-757a-4236-94f1-f355be098ff8),volume_type_id=ed4854f7-757a-4236-94f1-f355be098ff8)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Creating volume f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:40 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 1073741824 Jul 11 18:54:40 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:40 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 1073741824" returned: 0 in 0.812s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:40 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 Jul 11 18:54:40 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:41 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574" returned: 0 in 0.653s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:41 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Attempting download of 123abfe4-94f5-4201-89d9-ca5713751636 ((None, [{'url': 'file:///opt/stack/data/glance/images/123abfe4-94f5-4201-89d9-ca5713751636', 'metadata': {}}])) to volume f376ef70-23bf-4f2e-aa48-1fa0a850e574. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:54:41 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[def410cb-1cd1-4c4b-9a05-d8e65f81ba8d]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_123abfe4-94f5-4201-89d9-ca5713751636_pj3n9as6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:41 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_123abfe4-94f5-4201-89d9-ca5713751636_pj3n9as6 Jul 11 18:54:41 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "cinder-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "cinder-quobyte-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-quobyte-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3b9900-4ce2-4374-bd3f-864545a14d9c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:42 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f Jul 11 18:54:42 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:42 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_123abfe4-94f5-4201-89d9-ca5713751636_pj3n9as6" returned: 0 in 0.762s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_123abfe4-94f5-4201-89d9-ca5713751636_pj3n9as6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:42 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_123abfe4-94f5-4201-89d9-ca5713751636_pj3n9as6 Jul 11 18:54:42 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:42 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f" returned: 0 in 0.770s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:42 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f Jul 11 18:54:42 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:43 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_123abfe4-94f5-4201-89d9-ca5713751636_pj3n9as6" returned: 1 in 0.778s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_123abfe4-94f5-4201-89d9-ca5713751636_pj3n9as6' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a575643-4d61-4945-88d9-9faced52bcb3]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:43 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD Jul 11 18:54:43 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:43 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-quobyte-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f" released by "delete_volume" :: held 1.449s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Created reservations ['d63fa7dd-1c2f-4a6e-8643-44bc23485c8a', 'f9cbe568-ca0b-4f23-acf0-390a3a5d5a46', '9455f643-3dfe-4d28-a1d1-7a1983995c5d', '605d4302-3f24-4543-8c61-d446cad9e18f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:43 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:54:43 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:43 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:44 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD Jul 11 18:54:44 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:44 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "cinder-da8f7fce-548e-4e3a-a01e-0ccb27ee436a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.687s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Deleted volume successfully. Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-da8f7fce-548e-4e3a-a01e-0ccb27ee436a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3492923d-dcc3-47cc-a03d-4da1bb1936a5 tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-fbd9e0fc-595e-422c-ac6b-1c6cd7f6dd6f-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "cinder-quobyte-da8f7fce-548e-4e3a-a01e-0ccb27ee436a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-quobyte-da8f7fce-548e-4e3a-a01e-0ccb27ee436a" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfa43ac-68d0-4f0f-aa26-c8a5f95bedce]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:44 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a Jul 11 18:54:44 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:44 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD" returned: 1 in 0.793s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] 123abfe4-94f5-4201-89d9-ca5713751636 was raw, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:54:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:44 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 Jul 11 18:54:44 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:45 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a" returned: 0 in 0.786s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:45 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a Jul 11 18:54:45 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:45 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574" returned: 0 in 0.777s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:45 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_123abfe4-94f5-4201-89d9-ca5713751636_d2ekrqrgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:54:45 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 18:54:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:45 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 1G Jul 11 18:54:45 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:45 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-da8f7fce-548e-4e3a-a01e-0ccb27ee436a" returned: 0 in 0.682s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-quobyte-da8f7fce-548e-4e3a-a01e-0ccb27ee436a" released by "delete_volume" :: held 1.518s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Created reservations ['f2c72776-cba3-4780-90e5-23c7d693a6c3', 'e162b2a3-956f-45ce-98b6-92e143ea1269', '37017d14-2f3f-42c9-bcc7-be3588163028', '5b41d29d-6bba-4288-8e88-645898561ae9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:46 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:54:46 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:46 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 1G" returned: 0 in 0.703s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9488737e-fc44-4c50-9246-5d00a7c40187]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:46 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 Jul 11 18:54:46 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:46 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Deleted volume successfully. Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "cinder-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb073158-659f-492c-b25a-b17816c6852e tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-da8f7fce-548e-4e3a-a01e-0ccb27ee436a-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "cinder-quobyte-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-quobyte-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a4549c-ca7e-46a2-b916-1029443ed0f3]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:47 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee Jul 11 18:54:47 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:47 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574" returned: 0 in 0.872s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:47 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 Jul 11 18:54:47 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:47 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee" returned: 0 in 0.819s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:47 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee Jul 11 18:54:47 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:47 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574" returned: 1 in 0.834s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Downloaded image 123abfe4-94f5-4201-89d9-ca5713751636 ((None, [{'url': 'file:///opt/stack/data/glance/images/123abfe4-94f5-4201-89d9-ca5713751636', 'metadata': {}}])) to volume f376ef70-23bf-4f2e-aa48-1fa0a850e574 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Temporary image 123abfe4-94f5-4201-89d9-ca5713751636 for user 32c133ea72064618ad05b0c891924962 is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Marking volume f376ef70-23bf-4f2e-aa48-1fa0a850e574 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Copying metadata from image 123abfe4-94f5-4201-89d9-ca5713751636 to f376ef70-23bf-4f2e-aa48-1fa0a850e574. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:54:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Creating volume glance metadata for volume f376ef70-23bf-4f2e-aa48-1fa0a850e574 backed by image 123abfe4-94f5-4201-89d9-ca5713751636 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '123abfe4-94f5-4201-89d9-ca5713751636', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '673350ea9d5f6feac1b7195254e7c54d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868aaadc-5342-4b17-bd52-8d73c84d51fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574', 'volume_size': 1, 'image_id': '123abfe4-94f5-4201-89d9-ca5713751636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/123abfe4-94f5-4201-89d9-ca5713751636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673350ea9d5f6feac1b7195254e7c54d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fec972c7288d4178903ebc60086a5760', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88e90c954d02abd5aa4708ce98770a1e8d61ca839be0c769bcb2a96b07533113f3ce6bfdd9594d62238ef65b32c95b257e8067d1dd0987b8ab89494f8966a0cd', 'id': '123abfe4-94f5-4201-89d9-ca5713751636', 'created_at': datetime.datetime(2026, 7, 11, 16, 54, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 54, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/123abfe4-94f5-4201-89d9-ca5713751636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fec36b-c2bc-4fec-98e0-e4ea32547fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Volume volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 (f376ef70-23bf-4f2e-aa48-1fa0a850e574): created successfully Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fec36b-c2bc-4fec-98e0-e4ea32547fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Flow 'volume_create_manager' (b2dfe16e-bd6e-49c2-bbf8-55a86bf07d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5a5d90d7-982d-433c-ba52-eb240ef82478 tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Created volume successfully. Jul 11 18:54:48 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee" returned: 0 in 0.704s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-quobyte-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee" released by "delete_volume" :: held 1.578s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Created reservations ['a9c1c221-2ab1-4f7d-b867-7f9e76d6a3b7', 'fb9bd487-14d4-4afc-bbc2-69167610b7da', '294d3aa4-47bc-4a9a-8c58-ce1b13d43cd1', '76f1b124-9ac6-47f5-acc1-0a93c6adabaa'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:48 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:54:48 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Acquiring lock "cinder-f376ef70-23bf-4f2e-aa48-1fa0a850e574-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "cinder-f376ef70-23bf-4f2e-aa48-1fa0a850e574-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Acquiring lock "cinder-quobyte-f376ef70-23bf-4f2e-aa48-1fa0a850e574" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "cinder-quobyte-f376ef70-23bf-4f2e-aa48-1fa0a850e574" acquired by "delete_volume" :: waited 0.040s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc146179-b5fc-4b2c-9618-39eff4270458]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:49 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 Jul 11 18:54:49 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:49 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Deleted volume successfully. Jul 11 18:54:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1832468a-65ef-480b-8753-42727ea3aaac tempest-AttachVolumeNegativeTest-1554925873 None] Lock "cinder-e7d9f37a-8735-42a4-8bd5-b2a125ce9fee-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:49 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574" returned: 0 in 0.891s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:50 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 Jul 11 18:54:50 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:50 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574" returned: 1 in 0.825s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:50 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574 Jul 11 18:54:50 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:51 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f376ef70-23bf-4f2e-aa48-1fa0a850e574" returned: 0 in 0.690s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "cinder-quobyte-f376ef70-23bf-4f2e-aa48-1fa0a850e574" released by "delete_volume" :: held 2.485s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:51 devstack cinder-volume[87167]: WARNING cinder.quota [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:54:51 devstack cinder-volume[87167]: WARNING cinder.quota [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Created reservations ['018d9313-5293-4081-995d-96bb9f09b532', '5431e733-b20d-4861-9f83-9241888cd275', '84462f63-c81d-4db6-b137-894e20d0b060', '423f0352-3c6e-43bd-994a-6eaacb6e3bdf'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:51 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:54:51 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:52 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Deleted volume successfully. Jul 11 18:54:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86becaf7-6b49-4a18-9f4f-e94f73290b3a tempest-VolumeAndVolumeTypeFromImageTest-2097815385 None] Lock "cinder-f376ef70-23bf-4f2e-aa48-1fa0a850e574-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8c61c7a4-d7de-4e9a-8493-96d9728a6957 req-fb4883f9-75dd-4ca9-b255-919b3f8d33c0 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8c61c7a4-d7de-4e9a-8493-96d9728a6957 req-fb4883f9-75dd-4ca9-b255-919b3f8d33c0 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7c90f-52ef-434d-b0c6-14d4d084b4e6]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-8c61c7a4-d7de-4e9a-8493-96d9728a6957 req-fb4883f9-75dd-4ca9-b255-919b3f8d33c0 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:56 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb Jul 11 18:54:56 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Flow 'volume_create_manager' (4d61a6a7-d093-46cf-8159-6331237e8d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654d8915-000a-4bca-bc23-c9214226b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654d8915-000a-4bca-bc23-c9214226b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064bbeca4f5d4b2ebc910019bc69eff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:57Z,use_quota=True,user_id='8ff14571069945ceb92a88efd190079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab67cda-e0d3-4aa4-8963-c08553b4592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab67cda-e0d3-4aa4-8963-c08553b4592e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a6688f-0a09-4b3a-b9a8-b316ac80cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a6688f-0a09-4b3a-b9a8-b316ac80cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5', 'volume_name': 'volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5405f2a8-28c1-4c8d-9edb-98e42a886260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5405f2a8-28c1-4c8d-9edb-98e42a886260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4378fb-5533-4b79-ab08-a567a58f04b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Volume 58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5', 'volume_size': 1} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:57 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-8c61c7a4-d7de-4e9a-8493-96d9728a6957 req-fb4883f9-75dd-4ca9-b255-919b3f8d33c0 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb" returned: 0 in 0.844s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8c61c7a4-d7de-4e9a-8493-96d9728a6957 req-fb4883f9-75dd-4ca9-b255-919b3f8d33c0 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064bbeca4f5d4b2ebc910019bc69eff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:57Z,use_quota=True,user_id='8ff14571069945ceb92a88efd190079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Creating volume 58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:57 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:57 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 1073741824 Jul 11 18:54:57 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-8c61c7a4-d7de-4e9a-8493-96d9728a6957 req-fb4883f9-75dd-4ca9-b255-919b3f8d33c0 tempest-TestInstancesWithCinderVolumes-1239825512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-8d5f2646-2332-44ca-8260-a8addf779cdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41e9d252-c2fd-4584-af38-a252d9055494', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:54:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-8c61c7a4-d7de-4e9a-8493-96d9728a6957 req-fb4883f9-75dd-4ca9-b255-919b3f8d33c0 tempest-TestInstancesWithCinderVolumes-1239825512 None] attachment_update completed successfully. Jul 11 18:54:58 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 1073741824" returned: 0 in 0.951s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:58 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 Jul 11 18:54:58 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:59 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5" returned: 0 in 0.718s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4378fb-5533-4b79-ab08-a567a58f04b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7abd5b-4977-42b5-8f4a-274ede523d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Volume volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 (58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5): created successfully Jul 11 18:54:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7abd5b-4977-42b5-8f4a-274ede523d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Flow 'volume_create_manager' (4d61a6a7-d093-46cf-8159-6331237e8d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d9e7fbd5-e35b-4706-bc90-8f139accc9a2 tempest-CinderUnicodeTest-889181798 None] Created volume successfully. Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Flow 'volume_create_manager' (6e66c446-0872-44d0-97b8-c9617c1e85d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc996f7-ddcd-4473-bb6c-7dba6f6ab63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc996f7-ddcd-4473-bb6c-7dba6f6ab63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1550689060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6634409a-0e2a-4c73-b3d7-cf063709d321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064bbeca4f5d4b2ebc910019bc69eff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:00Z,use_quota=True,user_id='8ff14571069945ceb92a88efd190079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461901e5-674d-4281-992f-63e7d3cd7190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461901e5-674d-4281-992f-63e7d3cd7190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2692cd81-99f7-4ab2-85f7-be752768c631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2692cd81-99f7-4ab2-85f7-be752768c631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6634409a-0e2a-4c73-b3d7-cf063709d321', 'volume_name': 'volume-6634409a-0e2a-4c73-b3d7-cf063709d321', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c0c92-9359-497e-8f80-09cc4be0b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c0c92-9359-497e-8f80-09cc4be0b30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e4d48f-4410-4408-8d08-bee3a184d822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Volume 6634409a-0e2a-4c73-b3d7-cf063709d321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6634409a-0e2a-4c73-b3d7-cf063709d321', 'volume_size': 1} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1550689060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6634409a-0e2a-4c73-b3d7-cf063709d321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064bbeca4f5d4b2ebc910019bc69eff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:00Z,use_quota=True,user_id='8ff14571069945ceb92a88efd190079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Creating volume 6634409a-0e2a-4c73-b3d7-cf063709d321 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:00 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:55:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:00 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 1073741824 Jul 11 18:55:00 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:01 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 1073741824" returned: 0 in 0.832s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:01 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 Jul 11 18:55:01 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:01 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321" returned: 0 in 0.817s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e4d48f-4410-4408-8d08-bee3a184d822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6634409a-0e2a-4c73-b3d7-cf063709d321', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bc28b3-fc29-4db0-a206-be987c80329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Volume volume-6634409a-0e2a-4c73-b3d7-cf063709d321 (6634409a-0e2a-4c73-b3d7-cf063709d321): created successfully Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bc28b3-fc29-4db0-a206-be987c80329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Flow 'volume_create_manager' (6e66c446-0872-44d0-97b8-c9617c1e85d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b50a2a4f-a9ce-43f5-a16f-ad1f17a15cf7 tempest-CinderUnicodeTest-889181798 None] Created volume successfully. Jul 11 18:55:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Creating offline snapshot c5a3164e-2ba1-4be8-9f42-82a29258d22f of volume 6634409a-0e2a-4c73-b3d7-cf063709d321 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:55:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb52936a-106a-46dd-a6de-605a3ee90114]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:02 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 Jul 11 18:55:02 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:03 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321" returned: 0 in 0.845s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:03 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f 1G Jul 11 18:55:03 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:04 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f 1G" returned: 0 in 0.879s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6634409a-0e2a-4c73-b3d7-cf063709d321 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:04 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6634409a-0e2a-4c73-b3d7-cf063709d321 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f Jul 11 18:55:04 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:05 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6634409a-0e2a-4c73-b3d7-cf063709d321 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f" returned: 0 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:05 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f is being set with open permissions: ugo+rw Jul 11 18:55:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:05 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f Jul 11 18:55:05 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-fe56c376-52e9-483c-bb18-473cc7421e9b req-e268e3ef-4dde-4953-bec6-bb9693579666 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:05 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f" returned: 0 in 0.680s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:05 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.info Jul 11 18:55:05 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:06 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.info" returned: 0 in 0.666s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:06 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.info is being set with open permissions: ugo+rw Jul 11 18:55:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:06 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.info Jul 11 18:55:06 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4466a8dc-fb6d-49ff-91ee-012d2feac0aa tempest-GroupsV320Test-1173067699 None] Group tempest-GroupsV320Test-Group-1228042495: creating Jul 11 18:55:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4466a8dc-fb6d-49ff-91ee-012d2feac0aa tempest-GroupsV320Test-1173067699 None] Group tempest-GroupsV320Test-Group-1228042495: created successfully Jul 11 18:55:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4466a8dc-fb6d-49ff-91ee-012d2feac0aa tempest-GroupsV320Test-1173067699 None] Create group completed successfully. Jul 11 18:55:07 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.info" returned: 0 in 0.668s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.579s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-fe56c376-52e9-483c-bb18-473cc7421e9b req-e268e3ef-4dde-4953-bec6-bb9693579666 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.845s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a137559f-c168-461f-8fb1-81e5cf94d9a9]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-fe56c376-52e9-483c-bb18-473cc7421e9b req-e268e3ef-4dde-4953-bec6-bb9693579666 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bdeed83b-6acf-4bef-905e-e9efceedd2e8 tempest-CinderUnicodeTest-889181798 None] Create snapshot completed successfully Jul 11 18:55:07 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c Jul 11 18:55:07 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "cinder-c5a3164e-2ba1-4be8-9f42-82a29258d22f-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-c5a3164e-2ba1-4be8-9f42-82a29258d22f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "cinder-quobyte-6634409a-0e2a-4c73-b3d7-cf063709d321" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-quobyte-6634409a-0e2a-4c73-b3d7-cf063709d321" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "cinder-quobyte-c5a3164e-2ba1-4be8-9f42-82a29258d22f" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-quobyte-c5a3164e-2ba1-4be8-9f42-82a29258d22f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Deleting offline snapshot c5a3164e-2ba1-4be8-9f42-82a29258d22f of volume 6634409a-0e2a-4c73-b3d7-cf063709d321 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:55:07 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] snapshot_file for this snap is: volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-fe56c376-52e9-483c-bb18-473cc7421e9b req-e268e3ef-4dde-4953-bec6-bb9693579666 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c" returned: 0 in 0.801s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-fe56c376-52e9-483c-bb18-473cc7421e9b req-e268e3ef-4dde-4953-bec6-bb9693579666 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd0485e-1c1b-4fa5-bfaf-2e6c75485677]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-fe56c376-52e9-483c-bb18-473cc7421e9b req-e268e3ef-4dde-4953-bec6-bb9693579666 tempest-TestInstancesWithCinderVolumes-1239825512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-be0b9656-e802-482b-b6c7-638b3dc2e09c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5bb4004-cc0f-4c45-b722-454a24b4f66b', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:55:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-fe56c376-52e9-483c-bb18-473cc7421e9b req-e268e3ef-4dde-4953-bec6-bb9693579666 tempest-TestInstancesWithCinderVolumes-1239825512 None] attachment_update completed successfully. Jul 11 18:55:08 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f Jul 11 18:55:08 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Created reservations ['8baa8959-6400-458f-8ae3-0de99e3c9f1d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:08 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:08 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:08 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f" returned: 0 in 0.802s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6634409a-0e2a-4c73-b3d7-cf063709d321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d4f6fc-c072-410e-b98f-63a4a149d426]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:08 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 Jul 11 18:55:08 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:09 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.695s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:09 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5d3f4b1f-d28f-4762-b497-94dfcd825c47 tempest-GroupsV320Test-1173067699 None] Delete group completed successfully. Jul 11 18:55:09 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321" returned: 0 in 0.771s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:09 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f Jul 11 18:55:09 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:10 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:10 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f Jul 11 18:55:10 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:10 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321.c5a3164e-2ba1-4be8-9f42-82a29258d22f" returned: 0 in 0.644s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-quobyte-c5a3164e-2ba1-4be8-9f42-82a29258d22f" released by "_delete_snapshot" :: held 3.101s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-quobyte-6634409a-0e2a-4c73-b3d7-cf063709d321" released by "delete_snapshot" :: held 3.128s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Created reservations ['02271c31-7fb1-4f08-b0c4-d5703d08c3b1', '85706941-4a5a-433a-a11c-af893a4de5e4', '2eff4fc2-3f71-4c1c-b808-57620fd03b5e', '9595f52b-c95b-4368-9930-36158cde5f70'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Delete snapshot completed successfully. Jul 11 18:55:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5db86060-be38-4b59-b94a-24d05b8c8de7 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-c5a3164e-2ba1-4be8-9f42-82a29258d22f-delete_snapshot" released by "delete_snapshot" :: held 3.275s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "cinder-6634409a-0e2a-4c73-b3d7-cf063709d321-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-6634409a-0e2a-4c73-b3d7-cf063709d321-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "cinder-quobyte-6634409a-0e2a-4c73-b3d7-cf063709d321" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-quobyte-6634409a-0e2a-4c73-b3d7-cf063709d321" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5c5809-f635-4709-841c-cd74bb6f6165]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:12 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 Jul 11 18:55:12 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:13 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321" returned: 0 in 0.898s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:13 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321 Jul 11 18:55:13 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:13 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6634409a-0e2a-4c73-b3d7-cf063709d321" returned: 0 in 0.779s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-quobyte-6634409a-0e2a-4c73-b3d7-cf063709d321" released by "delete_volume" :: held 1.746s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Created reservations ['ab3ccfdb-89f7-443f-8735-0b3a59954384', 'e5eade3b-115b-406c-9e3c-e4f1942848f6', '5fac63b1-de41-444a-a178-773f56fc57ad', 'd87fb7ec-b6e6-44ed-928e-0b54ae810964'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:14 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:14 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "cinder-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "cinder-quobyte-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-quobyte-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[caedc9f5-8bba-4cfb-8bc7-5bc64a84ae98]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:14 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 Jul 11 18:55:14 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:14 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.773s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Deleted volume successfully. Jul 11 18:55:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4b21fa0b-4042-446d-a713-3f984d50c952 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-6634409a-0e2a-4c73-b3d7-cf063709d321-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:15 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:15 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:15 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5" returned: 0 in 0.955s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:15 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5 Jul 11 18:55:15 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Flow 'volume_create_manager' (49575634-df66-4961-aaed-2e18d3ec70aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33112479-e998-4e4d-bea9-971c7f4abd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33112479-e998-4e4d-bea9-971c7f4abd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1363313372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a0f908-2934-4271-9499-e17b61f38fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a256f240a54a15ac128b2f0c72a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:16Z,use_quota=True,user_id='0a33b96b4cd645d6949f02aae794b20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e010515c-2b23-45c4-952a-3d5131c80aab),volume_type_id=e010515c-2b23-45c4-952a-3d5131c80aab)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9348e311-25d5-4e79-9e86-55b0531e2ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9348e311-25d5-4e79-9e86-55b0531e2ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e8b458-c358-4e2b-87cb-ebb3f4ba5eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e8b458-c358-4e2b-87cb-ebb3f4ba5eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a0f908-2934-4271-9499-e17b61f38fd9', 'volume_name': 'volume-12a0f908-2934-4271-9499-e17b61f38fd9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:15 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677d50a5-a514-46d5-9f86-8df8f8dce196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677d50a5-a514-46d5-9f86-8df8f8dce196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103fee03-3fdb-4c6f-ba49-730edbbbf91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Volume 12a0f908-2934-4271-9499-e17b61f38fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a0f908-2934-4271-9499-e17b61f38fd9', 'volume_size': 1} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1363313372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a0f908-2934-4271-9499-e17b61f38fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a256f240a54a15ac128b2f0c72a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:16Z,use_quota=True,user_id='0a33b96b4cd645d6949f02aae794b20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e010515c-2b23-45c4-952a-3d5131c80aab),volume_type_id=e010515c-2b23-45c4-952a-3d5131c80aab)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Creating volume 12a0f908-2934-4271-9499-e17b61f38fd9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:15 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.905s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:55:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:55:15 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 1073741824 Jul 11 18:55:15 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:16 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5" returned: 0 in 0.777s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-quobyte-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5" released by "delete_volume" :: held 1.785s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Created reservations ['63c55808-1858-43fd-8012-ee0506f75ab3', 'ce0337bd-dae7-449f-b1b0-02d6d3d6fc05', 'dc71342f-65f3-4087-928f-236ce6d25c5e', '5d25d714-9078-4e5d-b1be-f7e25a843f9d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:16 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:16 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:16 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 1073741824" returned: 0 in 0.951s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:16 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 Jul 11 18:55:16 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:17 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Deleted volume successfully. Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00596b8b-c743-466d-9226-61935b75f8f8 tempest-CinderUnicodeTest-889181798 None] Lock "cinder-58fd4d5a-11d4-4f2b-85bf-1e03d13ae1f5-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:17 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9" returned: 0 in 0.730s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103fee03-3fdb-4c6f-ba49-730edbbbf91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a0f908-2934-4271-9499-e17b61f38fd9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cda6401-f18a-4ed9-ae8f-272938f142d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Volume volume-12a0f908-2934-4271-9499-e17b61f38fd9 (12a0f908-2934-4271-9499-e17b61f38fd9): created successfully Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cda6401-f18a-4ed9-ae8f-272938f142d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Flow 'volume_create_manager' (49575634-df66-4961-aaed-2e18d3ec70aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8d757940-562c-40fe-896f-4d80831a76d5 tempest-VolumeTypesAccessTest-1865533889 None] Created volume successfully. Jul 11 18:55:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-7bdaeea6-2269-4048-abc4-ecf71ea042ec req-a4ac7584-87df-4a48-bda6-7617698c0928 tempest-TestInstancesWithCinderVolumes-1239825512 None] Terminate volume connection completed successfully. Jul 11 18:55:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-7bdaeea6-2269-4048-abc4-ecf71ea042ec req-a4ac7584-87df-4a48-bda6-7617698c0928 tempest-TestInstancesWithCinderVolumes-1239825512 None] Deleting attachment 41e9d252-c2fd-4584-af38-a252d9055494. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:55:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Acquiring lock "cinder-12a0f908-2934-4271-9499-e17b61f38fd9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Lock "cinder-12a0f908-2934-4271-9499-e17b61f38fd9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Acquiring lock "cinder-quobyte-12a0f908-2934-4271-9499-e17b61f38fd9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Lock "cinder-quobyte-12a0f908-2934-4271-9499-e17b61f38fd9" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d98fbb8-dd29-4bc7-85bd-b9e17e365afe]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:18 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 Jul 11 18:55:18 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:18 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9" returned: 0 in 0.770s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:18 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9 Jul 11 18:55:18 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:19 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-12a0f908-2934-4271-9499-e17b61f38fd9" returned: 0 in 0.645s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Lock "cinder-quobyte-12a0f908-2934-4271-9499-e17b61f38fd9" released by "delete_volume" :: held 1.459s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:19 devstack cinder-volume[87167]: WARNING cinder.quota [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1281115912 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1281115912, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:19 devstack cinder-volume[87167]: WARNING cinder.quota [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1281115912 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1281115912, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Created reservations ['a136f953-534c-419a-a4aa-b25e874944e4', 'a13b87e0-379c-47ce-8a8e-5ef47564fc4c', '6367dc3d-da0e-447c-8f2a-867ac94938e0', 'f4e165d6-ef71-4d7b-818f-33c5ba4e9c27'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:19 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:19 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "cinder-8d5f2646-2332-44ca-8260-a8addf779cdb-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-8d5f2646-2332-44ca-8260-a8addf779cdb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "cinder-quobyte-8d5f2646-2332-44ca-8260-a8addf779cdb" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-quobyte-8d5f2646-2332-44ca-8260-a8addf779cdb" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac70dee-2ae0-44fc-8f27-1b6abd16b7f0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:20 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb Jul 11 18:55:20 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:20 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.965s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:20 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Deleted volume successfully. Jul 11 18:55:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275d5a77-7a9f-46ec-9387-57a7c470e924 tempest-VolumeTypesAccessTest-1865533889 None] Lock "cinder-12a0f908-2934-4271-9499-e17b61f38fd9-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:21 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb" returned: 0 in 1.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:21 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb Jul 11 18:55:21 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:21 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8d5f2646-2332-44ca-8260-a8addf779cdb" returned: 0 in 0.877s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-quobyte-8d5f2646-2332-44ca-8260-a8addf779cdb" released by "delete_volume" :: held 1.974s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:22 devstack cinder-volume[87167]: WARNING cinder.quota [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1198181401-1096494350 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1198181401-1096494350, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:22 devstack cinder-volume[87167]: WARNING cinder.quota [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1198181401-1096494350 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1198181401-1096494350, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Created reservations ['252ace07-3d6e-4bcb-8b63-4cae167ef9f5', '9202c9dd-2459-439e-bf08-e205416ff0ca', '20228af5-001d-44ba-8f01-9da25c4b6e76', 'f8d38b06-91b3-4140-b377-e4ecbcc6a115'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:22 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:22 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:23 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.802s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:23 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Deleted volume successfully. Jul 11 18:55:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-84c47f4a-f705-4a9e-bc0a-700173e83a4d tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-8d5f2646-2332-44ca-8260-a8addf779cdb-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-813ab664-778a-464d-8adf-5b4933151595 req-1dbb2db2-b9dc-4847-8ecb-0e863e1e6acb tempest-TestInstancesWithCinderVolumes-1239825512 None] Terminate volume connection completed successfully. Jul 11 18:55:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-813ab664-778a-464d-8adf-5b4933151595 req-1dbb2db2-b9dc-4847-8ecb-0e863e1e6acb tempest-TestInstancesWithCinderVolumes-1239825512 None] Deleting attachment c5bb4004-cc0f-4c45-b722-454a24b4f66b. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Flow 'volume_create_manager' (35e899b7-5e82-477c-ab1e-d75edf273b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9a5511-8bf9-4cb3-91a4-36a292631687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9a5511-8bf9-4cb3-91a4-36a292631687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871521456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce722cb-adf5-4975-b559-a12dd65b1052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2f70c1d3ab490c9df04d8fb9c8bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:27Z,use_quota=True,user_id='dba8e0d73f714cde985b6d62c6a9a226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a2cef-c42b-45fe-8e85-62934f063541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a2cef-c42b-45fe-8e85-62934f063541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1e7138-0043-488e-9c1a-b3b5bf7bf0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1e7138-0043-488e-9c1a-b3b5bf7bf0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce722cb-adf5-4975-b559-a12dd65b1052', 'volume_name': 'volume-2ce722cb-adf5-4975-b559-a12dd65b1052', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc401ca-6d91-4ce6-b076-d9778e55ac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc401ca-6d91-4ce6-b076-d9778e55ac81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd2e690-9cc7-429c-b483-d19c4aaf52c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Volume 2ce722cb-adf5-4975-b559-a12dd65b1052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce722cb-adf5-4975-b559-a12dd65b1052', 'volume_size': 1} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871521456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce722cb-adf5-4975-b559-a12dd65b1052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2f70c1d3ab490c9df04d8fb9c8bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:27Z,use_quota=True,user_id='dba8e0d73f714cde985b6d62c6a9a226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Creating volume 2ce722cb-adf5-4975-b559-a12dd65b1052 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:26 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:55:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:26 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 1073741824 Jul 11 18:55:26 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "cinder-be0b9656-e802-482b-b6c7-638b3dc2e09c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-be0b9656-e802-482b-b6c7-638b3dc2e09c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "cinder-quobyte-be0b9656-e802-482b-b6c7-638b3dc2e09c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-quobyte-be0b9656-e802-482b-b6c7-638b3dc2e09c" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9c915b-1d2d-477c-a8e0-50c6bd65b3db]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:27 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c Jul 11 18:55:27 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:27 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 1073741824" returned: 0 in 1.032s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:27 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 Jul 11 18:55:27 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:28 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c" returned: 0 in 0.956s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:28 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c Jul 11 18:55:28 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:28 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052" returned: 0 in 0.789s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd2e690-9cc7-429c-b483-d19c4aaf52c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce722cb-adf5-4975-b559-a12dd65b1052', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f8f430-041f-449a-8e78-a4c953bc1eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Volume volume-2ce722cb-adf5-4975-b559-a12dd65b1052 (2ce722cb-adf5-4975-b559-a12dd65b1052): created successfully Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f8f430-041f-449a-8e78-a4c953bc1eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Flow 'volume_create_manager' (35e899b7-5e82-477c-ab1e-d75edf273b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-86f560c3-4b76-4367-84e8-7db5e8089742 tempest-ProjectReaderTests-881204081 None] Created volume successfully. Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Acquiring lock "cinder-2ce722cb-adf5-4975-b559-a12dd65b1052-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Lock "cinder-2ce722cb-adf5-4975-b559-a12dd65b1052-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Acquiring lock "cinder-quobyte-2ce722cb-adf5-4975-b559-a12dd65b1052" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Lock "cinder-quobyte-2ce722cb-adf5-4975-b559-a12dd65b1052" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:29 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-be0b9656-e802-482b-b6c7-638b3dc2e09c" returned: 0 in 0.979s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b300caeb-e0fa-4c8c-a709-bc0e2b3192a5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-quobyte-be0b9656-e802-482b-b6c7-638b3dc2e09c" released by "delete_volume" :: held 1.993s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:29 devstack cinder-volume[87167]: WARNING cinder.quota [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1664736087-1461278142 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1664736087-1461278142, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:29 devstack cinder-volume[87167]: WARNING cinder.quota [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1664736087-1461278142 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1664736087-1461278142, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Created reservations ['293466a1-6677-4b06-beed-c375d585b544', '4bda5de8-0f38-41d4-84c2-37adbe976369', '2f8f9b54-757a-4a1f-9080-e103cfcff7c5', '882e6750-1abc-44de-9584-65b035f1bc7c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:29 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 Jul 11 18:55:29 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:29 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:29 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:30 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052" returned: 0 in 0.999s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:30 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052 Jul 11 18:55:30 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:30 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.938s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:30 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Deleted volume successfully. Jul 11 18:55:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-acc805dc-3645-4d80-878f-3c0e5d7ea281 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-be0b9656-e802-482b-b6c7-638b3dc2e09c-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:31 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2ce722cb-adf5-4975-b559-a12dd65b1052" returned: 0 in 0.956s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Lock "cinder-quobyte-2ce722cb-adf5-4975-b559-a12dd65b1052" released by "delete_volume" :: held 2.019s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Created reservations ['600c47d0-f4e7-402b-ad12-b65e08ffabe2', 'a6f87e6b-b2e3-4807-8f96-a6200f8e0fa2', '26913341-c99c-4c57-8d93-7e1838902b15', 'd502f1d4-6892-462c-8aa6-2fc82468b4a6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:31 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:31 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Flow 'volume_create_manager' (3eb95665-1a5a-4b09-ac93-8014b8d4d9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260514eb-4f7a-4dac-a1ec-cb3e4c7db1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260514eb-4f7a-4dac-a1ec-cb3e4c7db1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1571868968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e56562-066d-401d-a4dd-9f3f5a9e857a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2f70c1d3ab490c9df04d8fb9c8bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:32Z,use_quota=True,user_id='dba8e0d73f714cde985b6d62c6a9a226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bee5e41-5672-4e4f-a623-91bc0d89c4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bee5e41-5672-4e4f-a623-91bc0d89c4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1b7fc6-296a-4f56-8511-fc55447184cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1b7fc6-296a-4f56-8511-fc55447184cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e56562-066d-401d-a4dd-9f3f5a9e857a', 'volume_name': 'volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:32 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f88c1a-267c-4b11-b644-860067537b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f88c1a-267c-4b11-b644-860067537b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6a82d9-b72c-4929-8bc7-6d0c126cb7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Volume c3e56562-066d-401d-a4dd-9f3f5a9e857a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a', 'volume_size': 1} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1571868968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e56562-066d-401d-a4dd-9f3f5a9e857a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2f70c1d3ab490c9df04d8fb9c8bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:32Z,use_quota=True,user_id='dba8e0d73f714cde985b6d62c6a9a226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Creating volume c3e56562-066d-401d-a4dd-9f3f5a9e857a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:32 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.772s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Deleted volume successfully. Jul 11 18:55:32 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a 1073741824 Jul 11 18:55:32 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c23d75d-26db-4855-909d-b8570dc920fd tempest-ProjectReaderTests-881204081 None] Lock "cinder-2ce722cb-adf5-4975-b559-a12dd65b1052-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:33 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a 1073741824" returned: 0 in 1.194s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:33 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a Jul 11 18:55:33 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:34 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a" returned: 0 in 0.869s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6a82d9-b72c-4929-8bc7-6d0c126cb7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60661494-3be7-4780-887b-189fa219fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Volume volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a (c3e56562-066d-401d-a4dd-9f3f5a9e857a): created successfully Jul 11 18:55:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60661494-3be7-4780-887b-189fa219fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Flow 'volume_create_manager' (3eb95665-1a5a-4b09-ac93-8014b8d4d9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1714c3b2-898d-4a9f-b2d8-e361132d4c60 tempest-ProjectReaderTests-881204081 None] Created volume successfully. Jul 11 18:55:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Acquiring lock "cinder-c3e56562-066d-401d-a4dd-9f3f5a9e857a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Lock "cinder-c3e56562-066d-401d-a4dd-9f3f5a9e857a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Acquiring lock "cinder-quobyte-c3e56562-066d-401d-a4dd-9f3f5a9e857a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Lock "cinder-quobyte-c3e56562-066d-401d-a4dd-9f3f5a9e857a" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec451105-8f7a-4cfc-9705-c525a948b4aa]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-383154f3-6b8e-4413-8a80-2c2657cbf4da req-510a83c3-bddc-4c6f-8928-1a699d179a7d tempest-TestInstancesWithCinderVolumes-1239825512 None] Terminate volume connection completed successfully. Jul 11 18:55:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-383154f3-6b8e-4413-8a80-2c2657cbf4da req-510a83c3-bddc-4c6f-8928-1a699d179a7d tempest-TestInstancesWithCinderVolumes-1239825512 None] Deleting attachment 20975662-6da2-4172-9d1f-b1a2cfec320b. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:55:35 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a Jul 11 18:55:35 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:36 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a" returned: 0 in 0.828s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:36 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a Jul 11 18:55:36 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:37 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c3e56562-066d-401d-a4dd-9f3f5a9e857a" returned: 0 in 0.705s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Lock "cinder-quobyte-c3e56562-066d-401d-a4dd-9f3f5a9e857a" released by "delete_volume" :: held 1.579s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=91,cinder:INSERT=31,cinder:UPDATE=121,cinder:DELETE=9 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=108,cinder:UPDATE=106,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Created reservations ['821647f0-42bb-4fb5-8af4-90b16689c05f', '3a9fddc9-321c-4270-b8c4-88789c62ce6b', 'dd1aa3cd-cd9d-4174-9a30-603c6208434c', 'd9bdda8f-7659-4a56-90b8-eecdc6a7e622'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:37 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:37 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:37 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.700s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Deleted volume successfully. Jul 11 18:55:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f5fa1c-9401-4185-b7fa-f33f949a4e37 tempest-ProjectReaderTests-881204081 None] Lock "cinder-c3e56562-066d-401d-a4dd-9f3f5a9e857a-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Flow 'volume_create_manager' (517b4f48-1a17-4ce8-8c8c-4a1e1c82e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817d12ae-4ab4-4da6-9763-8739410a12f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817d12ae-4ab4-4da6-9763-8739410a12f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486312733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756ae85a-45a4-4583-82ce-93676960c276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2f70c1d3ab490c9df04d8fb9c8bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:38Z,use_quota=True,user_id='dba8e0d73f714cde985b6d62c6a9a226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d87ecf1-b344-426e-851c-e874478ac630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d87ecf1-b344-426e-851c-e874478ac630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ee46c1-d6ac-40d4-aacc-ee02fa6003ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ee46c1-d6ac-40d4-aacc-ee02fa6003ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756ae85a-45a4-4583-82ce-93676960c276', 'volume_name': 'volume-756ae85a-45a4-4583-82ce-93676960c276', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0ff6f6-17ec-432e-b1dd-67806786703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0ff6f6-17ec-432e-b1dd-67806786703c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5326f0-d326-4790-a56f-34568ffc7121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Volume 756ae85a-45a4-4583-82ce-93676960c276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756ae85a-45a4-4583-82ce-93676960c276', 'volume_size': 1} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486312733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756ae85a-45a4-4583-82ce-93676960c276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2f70c1d3ab490c9df04d8fb9c8bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:38Z,use_quota=True,user_id='dba8e0d73f714cde985b6d62c6a9a226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Creating volume 756ae85a-45a4-4583-82ce-93676960c276 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:38 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:38 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 1073741824 Jul 11 18:55:38 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "cinder-b5cfdb4f-c140-4060-926c-0fcc1ad75467-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-b5cfdb4f-c140-4060-926c-0fcc1ad75467-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "cinder-quobyte-b5cfdb4f-c140-4060-926c-0fcc1ad75467" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-quobyte-b5cfdb4f-c140-4060-926c-0fcc1ad75467" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[22028d6f-5291-4eeb-98f6-728a8d0ae75d]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:39 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:55:39 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:39 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 1073741824" returned: 0 in 0.995s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:39 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 Jul 11 18:55:39 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:39 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 0 in 0.816s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:39 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:55:39 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:40 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276" returned: 0 in 0.735s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5326f0-d326-4790-a56f-34568ffc7121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756ae85a-45a4-4583-82ce-93676960c276', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02888559-1128-42de-ac3f-f24384fe4858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Volume volume-756ae85a-45a4-4583-82ce-93676960c276 (756ae85a-45a4-4583-82ce-93676960c276): created successfully Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02888559-1128-42de-ac3f-f24384fe4858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Flow 'volume_create_manager' (517b4f48-1a17-4ce8-8c8c-4a1e1c82e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f0fa1adb-a9fa-4ff8-9826-1d0c52cf35fb tempest-ProjectReaderTests-881204081 None] Created volume successfully. Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Acquiring lock "cinder-756ae85a-45a4-4583-82ce-93676960c276-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Lock "cinder-756ae85a-45a4-4583-82ce-93676960c276-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Acquiring lock "cinder-quobyte-756ae85a-45a4-4583-82ce-93676960c276" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Lock "cinder-quobyte-756ae85a-45a4-4583-82ce-93676960c276" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffce0fff-38fc-4ce1-87af-efc2a2aae23d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:40 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 Jul 11 18:55:40 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:40 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 1 in 0.845s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:55:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:40 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467 Jul 11 18:55:40 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:41 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276" returned: 0 in 0.856s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:41 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b5cfdb4f-c140-4060-926c-0fcc1ad75467" returned: 0 in 0.692s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:41 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276 Jul 11 18:55:41 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-quobyte-b5cfdb4f-c140-4060-926c-0fcc1ad75467" released by "delete_volume" :: held 2.443s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:41 devstack cinder-volume[87167]: WARNING cinder.quota [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1725528541-683061298 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1725528541-683061298, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:41 devstack cinder-volume[87167]: WARNING cinder.quota [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1725528541-683061298 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1725528541-683061298, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Created reservations ['8a4a2a5c-bb79-4aae-b154-43cb86c5b6a1', 'd3d0d039-2e2b-4f9c-8c40-8692a214a434', '8326a109-0eb6-45f6-a475-e8ffcafad073', '1709cb44-38cc-4f65-a6b5-d60b231aa9aa'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:41 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:41 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:41 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-756ae85a-45a4-4583-82ce-93676960c276" returned: 0 in 0.679s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Lock "cinder-quobyte-756ae85a-45a4-4583-82ce-93676960c276" released by "delete_volume" :: held 1.592s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Created reservations ['bbd3dc80-179e-45fd-b2fb-0f30e41582fe', '69939bae-1f9c-4c1a-a265-d41f726222f7', '82d75f83-0a98-4acb-a194-a8f607fcb7d6', '680e279f-0451-451d-b813-b4ebb8be7e76'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:42 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:42 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:42 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.723s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Deleted volume successfully. Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e3137d2b-7180-49d8-be3d-c0a5b03e0456 tempest-TestInstancesWithCinderVolumes-1239825512 None] Lock "cinder-b5cfdb4f-c140-4060-926c-0fcc1ad75467-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:42 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Deleted volume successfully. Jul 11 18:55:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b036bcc-da08-4010-b88a-024e022730d3 tempest-ProjectReaderTests-881204081 None] Lock "cinder-756ae85a-45a4-4583-82ce-93676960c276-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Flow 'volume_create_manager' (921c7641-171a-4908-8ec9-59de91c9ec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f8012f-5637-46ec-979e-8084ba15bcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f8012f-5637-46ec-979e-8084ba15bcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657279549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f9dada-5463-48b1-933a-dbe51fea2b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2f70c1d3ab490c9df04d8fb9c8bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:43Z,use_quota=True,user_id='dba8e0d73f714cde985b6d62c6a9a226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30e3e5f-e8cc-4f2b-8ae9-c16a6881a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30e3e5f-e8cc-4f2b-8ae9-c16a6881a325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072ff298-2c29-47da-adfb-e918dfc3af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072ff298-2c29-47da-adfb-e918dfc3af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f9dada-5463-48b1-933a-dbe51fea2b77', 'volume_name': 'volume-40f9dada-5463-48b1-933a-dbe51fea2b77', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7d0dab-b063-4d0c-9011-9572fe168798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7d0dab-b063-4d0c-9011-9572fe168798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46eb8043-eadd-4061-95d5-bd41810852d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Volume 40f9dada-5463-48b1-933a-dbe51fea2b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f9dada-5463-48b1-933a-dbe51fea2b77', 'volume_size': 1} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657279549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f9dada-5463-48b1-933a-dbe51fea2b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2f70c1d3ab490c9df04d8fb9c8bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:43Z,use_quota=True,user_id='dba8e0d73f714cde985b6d62c6a9a226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Creating volume 40f9dada-5463-48b1-933a-dbe51fea2b77 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:43 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 1073741824 Jul 11 18:55:43 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Flow 'volume_create_manager' (649b0099-db6f-44a5-88c0-6adf47ea4f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95399c8-16e5-44ee-9131-3909bef2b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95399c8-16e5-44ee-9131-3909bef2b898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1786578645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8303cf73-27db-4897-853d-98e60ccde278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad410a65ee24b4cb225e42e25ab3c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:43Z,use_quota=True,user_id='f9d5a8e9044148f1a4ef1326f64ba121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963b16a5-60ee-467e-aaf0-0a9396858706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963b16a5-60ee-467e-aaf0-0a9396858706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b41e15b-50b2-41a6-a280-bb2feca4527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b41e15b-50b2-41a6-a280-bb2feca4527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8303cf73-27db-4897-853d-98e60ccde278', 'volume_name': 'volume-8303cf73-27db-4897-853d-98e60ccde278', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908a3773-3754-4ec3-ad2f-78e39e222052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908a3773-3754-4ec3-ad2f-78e39e222052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97efb7b-bc09-4cc6-9cde-47c08837652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Volume 8303cf73-27db-4897-853d-98e60ccde278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8303cf73-27db-4897-853d-98e60ccde278', 'volume_size': 1} Jul 11 18:55:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:44 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 1073741824" returned: 0 in 0.906s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:44 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 Jul 11 18:55:44 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:44 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77" returned: 0 in 0.669s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1786578645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8303cf73-27db-4897-853d-98e60ccde278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad410a65ee24b4cb225e42e25ab3c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:43Z,use_quota=True,user_id='f9d5a8e9044148f1a4ef1326f64ba121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Creating volume 8303cf73-27db-4897-853d-98e60ccde278 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:44 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:44 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 1073741824 Jul 11 18:55:44 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46eb8043-eadd-4061-95d5-bd41810852d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f9dada-5463-48b1-933a-dbe51fea2b77', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79eb8bfa-7e74-429a-8847-7cc1cf598ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:44 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Volume volume-40f9dada-5463-48b1-933a-dbe51fea2b77 (40f9dada-5463-48b1-933a-dbe51fea2b77): created successfully Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79eb8bfa-7e74-429a-8847-7cc1cf598ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Flow 'volume_create_manager' (921c7641-171a-4908-8ec9-59de91c9ec26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f9c25d7b-c675-4984-9e76-055727f2a51b tempest-ProjectReaderTests-881204081 None] Created volume successfully. Jul 11 18:55:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Acquiring lock "cinder-40f9dada-5463-48b1-933a-dbe51fea2b77-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Lock "cinder-40f9dada-5463-48b1-933a-dbe51fea2b77-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Acquiring lock "cinder-quobyte-40f9dada-5463-48b1-933a-dbe51fea2b77" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Lock "cinder-quobyte-40f9dada-5463-48b1-933a-dbe51fea2b77" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22cb2e2-6a05-4318-b7a4-0c6e9534d2a8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:45 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 Jul 11 18:55:45 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:45 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 1073741824" returned: 0 in 0.943s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:45 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 Jul 11 18:55:45 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:46 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77" returned: 0 in 0.954s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:46 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77 Jul 11 18:55:46 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:46 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278" returned: 0 in 0.778s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97efb7b-bc09-4cc6-9cde-47c08837652e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8303cf73-27db-4897-853d-98e60ccde278', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3944393-cf21-4a8b-8335-17d63c66cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Volume volume-8303cf73-27db-4897-853d-98e60ccde278 (8303cf73-27db-4897-853d-98e60ccde278): created successfully Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3944393-cf21-4a8b-8335-17d63c66cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Flow 'volume_create_manager' (649b0099-db6f-44a5-88c0-6adf47ea4f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1a1ddc9e-f7ab-46ba-9a3b-77c605c02ce9 tempest-AbsoluteLimitsTests-860737953 None] Created volume successfully. Jul 11 18:55:47 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-40f9dada-5463-48b1-933a-dbe51fea2b77" returned: 0 in 0.744s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Lock "cinder-quobyte-40f9dada-5463-48b1-933a-dbe51fea2b77" released by "delete_volume" :: held 1.755s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Created reservations ['97ea0b81-ae76-4566-9a32-62093ad3e762', 'c93f13d0-1f28-45e1-b8a5-46b1fcc55cdd', '460d6c39-3054-433a-8a48-9cdb23bccfb8', '6e323796-4cc1-4f5b-9f87-194e99df4d26'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:47 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:47 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Acquiring lock "cinder-8303cf73-27db-4897-853d-98e60ccde278-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Lock "cinder-8303cf73-27db-4897-853d-98e60ccde278-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Acquiring lock "cinder-quobyte-8303cf73-27db-4897-853d-98e60ccde278" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Lock "cinder-quobyte-8303cf73-27db-4897-853d-98e60ccde278" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3e9169-77ce-4fef-8b8b-762aa93d1943]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:48 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.926s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Deleted volume successfully. Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35b8339b-fdb5-4e17-952a-c522747c9541 tempest-ProjectReaderTests-881204081 None] Lock "cinder-40f9dada-5463-48b1-933a-dbe51fea2b77-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:48 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 Jul 11 18:55:48 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:48 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278" returned: 0 in 0.857s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:49 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278 Jul 11 18:55:49 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:49 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8303cf73-27db-4897-853d-98e60ccde278" returned: 0 in 0.728s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Lock "cinder-quobyte-8303cf73-27db-4897-853d-98e60ccde278" released by "delete_volume" :: held 1.657s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Created reservations ['086b32c5-2176-484f-95d2-fae3503ae053', '07a84e03-1f03-4034-8d16-9c070fc160e6', '0af727ff-7eb0-4f4f-a7d1-2b2815d46946', 'e6ed6176-9ec7-4699-8614-f03b747d51d0'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:49 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:55:49 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:50 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.732s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Deleted volume successfully. Jul 11 18:55:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5510b4f0-c713-42d4-8c6e-91535e760f5f tempest-AbsoluteLimitsTests-860737953 None] Lock "cinder-8303cf73-27db-4897-853d-98e60ccde278-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:59 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=44,cinder:SELECT=31,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:00 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=27,cinder:INSERT=15,cinder:UPDATE=53,cinder:DELETE=4 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Flow 'volume_create_manager' (d4c3b9e2-4be5-4d9a-97dc-96344b6e10ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5dbeec-a67f-4e9a-a8e9-5c3a70a4fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5dbeec-a67f-4e9a-a8e9-5c3a70a4fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-774863510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17d203cf6534246bd141a50426864d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:03Z,use_quota=True,user_id='e7dbd77fe2e34804bff8a03975d6c707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b672f81e-9e7c-4b6b-8fc2-bad9198c0bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b672f81e-9e7c-4b6b-8fc2-bad9198c0bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54aba5c3-bdde-4801-b01b-9e10e3f73722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54aba5c3-bdde-4801-b01b-9e10e3f73722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd', 'volume_name': 'volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86694f5b-9717-46c9-bed7-5a9df5f79cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86694f5b-9717-46c9-bed7-5a9df5f79cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1a287c-17b9-4466-9354-74ded126beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Volume f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd', 'volume_size': 1} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-774863510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17d203cf6534246bd141a50426864d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:03Z,use_quota=True,user_id='e7dbd77fe2e34804bff8a03975d6c707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Creating volume f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:02 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:56:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:02 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd 1073741824 Jul 11 18:56:02 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:03 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd 1073741824" returned: 0 in 0.820s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:03 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:56:03 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:04 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1a287c-17b9-4466-9354-74ded126beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e28b7c-b40b-462b-b30e-383b3a617d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Volume volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd (f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd): created successfully Jul 11 18:56:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e28b7c-b40b-462b-b30e-383b3a617d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Flow 'volume_create_manager' (d4c3b9e2-4be5-4d9a-97dc-96344b6e10ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4a59741c-c567-4aee-a683-4b489ff90be7 tempest-VolumesActionsTest-866668561 None] Created volume successfully. Jul 11 18:56:14 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:14 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:15 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:56:15 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:15 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:56:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:56:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b8969b79-5cf0-4612-abc1-39da7ce41e4d tempest-VolumesActionsTest-866668561 None] Acquiring lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" by "attach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b8969b79-5cf0-4612-abc1-39da7ce41e4d tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" acquired by "attach_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b8969b79-5cf0-4612-abc1-39da7ce41e4d tempest-VolumesActionsTest-866668561 None] Attaching volume f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd to instance 9ac8406f-a1c3-4541-9f0a-0995b0dec09c at mountpoint /dev/vdb on host None. Jul 11 18:56:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b8969b79-5cf0-4612-abc1-39da7ce41e4d tempest-VolumesActionsTest-866668561 None] Attach volume completed successfully. Jul 11 18:56:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b8969b79-5cf0-4612-abc1-39da7ce41e4d tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" released by "attach_volume" :: held 0.091s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0328569a-51a3-4315-bc49-6e3d86b663bc tempest-VolumesActionsTest-866668561 None] Acquiring lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-detach_volume" by "detach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0328569a-51a3-4315-bc49-6e3d86b663bc tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0328569a-51a3-4315-bc49-6e3d86b663bc tempest-VolumesActionsTest-866668561 None] Detaching volume f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd from instance 9ac8406f-a1c3-4541-9f0a-0995b0dec09c. Jul 11 18:56:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0328569a-51a3-4315-bc49-6e3d86b663bc tempest-VolumesActionsTest-866668561 None] Detach volume completed successfully. Jul 11 18:56:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0328569a-51a3-4315-bc49-6e3d86b663bc tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:30 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:30 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:INSERT=1,cinder:SELECT=6 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d6740ea0-15d0-4225-989b-459cfbfd5345 tempest-VolumesActionsTest-866668561 None] Acquiring lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" by "attach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d6740ea0-15d0-4225-989b-459cfbfd5345 tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" acquired by "attach_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d6740ea0-15d0-4225-989b-459cfbfd5345 tempest-VolumesActionsTest-866668561 None] Attaching volume f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd to instance 9bf670c0-5229-435d-9082-8de2694e9fae at mountpoint /dev/vdb on host None. Jul 11 18:56:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d6740ea0-15d0-4225-989b-459cfbfd5345 tempest-VolumesActionsTest-866668561 None] Attach volume completed successfully. Jul 11 18:56:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d6740ea0-15d0-4225-989b-459cfbfd5345 tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" released by "attach_volume" :: held 0.100s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-19afe82b-0e85-4e45-a48c-8e884193ba33 tempest-VolumesActionsTest-866668561 None] Acquiring lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-detach_volume" by "detach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-19afe82b-0e85-4e45-a48c-8e884193ba33 tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-19afe82b-0e85-4e45-a48c-8e884193ba33 tempest-VolumesActionsTest-866668561 None] Detaching volume f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd from instance 9bf670c0-5229-435d-9082-8de2694e9fae. Jul 11 18:56:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-19afe82b-0e85-4e45-a48c-8e884193ba33 tempest-VolumesActionsTest-866668561 None] Detach volume completed successfully. Jul 11 18:56:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-19afe82b-0e85-4e45-a48c-8e884193ba33 tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[62110dfc-4248-49be-b3f3-cf3ff27c4002]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:54 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:56:54 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:55 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:55 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.741s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[260450d0-a70b-430b-94aa-a4660075ca9f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:55 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:56:55 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:56 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.757s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.e6f54787-3828-4897-8626-757c87dfae3dde7idwt8.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:56 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.e6f54787-3828-4897-8626-757c87dfae3dde7idwt8.img Jul 11 18:56:56 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:00 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.e6f54787-3828-4897-8626-757c87dfae3dde7idwt8.img" returned: 0 in 4.148s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b755534d-4509-4027-a0ac-e9d8b4a5e277]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:00 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:57:00 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:01 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.897s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:01 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.e6f54787-3828-4897-8626-757c87dfae3dde7idwt8.img {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:57:01 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Converted 1024.00 MB image at 246.82 MB/s Jul 11 18:57:01 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] e6f54787-3828-4897-8626-757c87dfae3d was raw, no need to convert to raw {{(pid=87167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 11 18:57:04 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:57:11 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:15 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:57:15 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:15 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.690s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:57:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:57:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.316s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Uploaded volume to glance image-id: e6f54787-3828-4897-8626-757c87dfae3d. {{(pid=87167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 18:57:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c36af340-106c-45af-ad63-c0e6eb06d5c4 tempest-VolumesActionsTest-866668561 None] Copy volume to image completed successfully. Jul 11 18:57:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c0dec1-1e9a-4690-a10c-6f9e45b7a914]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:21 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:57:21 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:22 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.750s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d453aa-e920-4d48-b5cb-802697475d1a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:22 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:57:22 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:22 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.744s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:22 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img Jul 11 18:57:22 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:27 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img" returned: 0 in 4.215s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f460f-5a6a-4cbc-a83f-37fd6fbd1c38]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:27 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:57:27 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:27 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.893s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:27 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:57:27 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Converted 1024.00 MB image at 242.85 MB/s Jul 11 18:57:27 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] 6a525ca4-fd31-4f35-a31a-e559dcadbec7 was raw, converting to qcow2 {{(pid=87167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 11 18:57:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca25dadd-9a15-4f18-ae87-c1b8c8f55b60]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:28 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img Jul 11 18:57:28 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:28 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:28 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img Jul 11 18:57:28 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:29 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img" returned: 1 in 0.713s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:57:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img /opt/stack/data/cinder/conversion/vol_upload_60mxk7xn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:29 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img /opt/stack/data/cinder/conversion/vol_upload_60mxk7xn Jul 11 18:57:29 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:30 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img /opt/stack/data/cinder/conversion/vol_upload_60mxk7xn" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:30 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Image conversion details: src /opt/stack/data/cinder/conversion/f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd.temp_image.6a525ca4-fd31-4f35-a31a-e559dcadbec7n6mueyo9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_60mxk7xn {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:57:30 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 11 18:57:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff0e59f-1b2b-43e8-88fb-57f81f818069]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_60mxk7xn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:30 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_60mxk7xn Jul 11 18:57:30 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:30 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_60mxk7xn" returned: 0 in 0.703s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.622s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Uploaded volume to glance image-id: 6a525ca4-fd31-4f35-a31a-e559dcadbec7. {{(pid=87167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 18:57:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ac530219-8a90-4fa9-9dd5-5441c7ef5298 tempest-VolumesActionsTest-866668561 None] Copy volume to image completed successfully. Jul 11 18:57:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Acquiring lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:57:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:57:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Acquiring lock "cinder-quobyte-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:57:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Lock "cinder-quobyte-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:57:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aedd30-216b-43f3-a25a-544e67a2e49e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:33 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:57:33 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:34 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.739s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:34 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd Jul 11 18:57:34 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:34 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" returned: 0 in 0.631s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Lock "cinder-quobyte-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd" released by "delete_volume" :: held 1.405s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Created reservations ['83dd2822-2093-4fb7-9ccc-bac1cbb32af8', 'fee5aa6a-73ed-47dd-8b89-56286571304e', 'd3f49b45-6f91-4ae8-8351-2eaefb8598d7', 'cd66cf92-59e9-4506-9f0c-dfab8087b2af'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:34 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:57:34 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:35 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:35 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:57:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Deleted volume successfully. Jul 11 18:57:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-30342b88-e627-4dfd-92d9-8c0e5757c3f7 tempest-VolumesActionsTest-866668561 None] Lock "cinder-f64d0de9-3be5-4bb0-ae6f-c329b8bd48cd-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Flow 'volume_create_manager' (dc526165-ab29-4f50-bbf4-236269741c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61ccd50-5a08-4ade-8b0b-e550fd8b5b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61ccd50-5a08-4ade-8b0b-e550fd8b5b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1361933039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dfe2a0-61ad-465b-9a4e-7db350f7666e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbabc8aefb804f85a8d085c5ddb946eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:57:41Z,use_quota=True,user_id='615c0acb4f71440d96f8e0a472d7db29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a117f7-b774-430c-aeb2-10744c182cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a117f7-b774-430c-aeb2-10744c182cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839b5434-98fd-4e0c-a03d-c90b97321cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839b5434-98fd-4e0c-a03d-c90b97321cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52dfe2a0-61ad-465b-9a4e-7db350f7666e', 'volume_name': 'volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4f6a1d-1c15-4702-bd1c-be9c7a1778f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4f6a1d-1c15-4702-bd1c-be9c7a1778f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16441cb-0999-4b54-9bd0-c2bf4cbf6a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Volume 52dfe2a0-61ad-465b-9a4e-7db350f7666e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Trying to clone 52dfe2a0-61ad-465b-9a4e-7db350f7666e from image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:57:41 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de1149-f995-4d70-9c22-058d32f8cf0b]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:41 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD Jul 11 18:57:41 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:42 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD" returned: 0 in 0.717s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:42 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Temporary image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 is fetched for user 615c0acb4f71440d96f8e0a472d7db29. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:57:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[759038e2-d54d-4de3-bd7a-d9547f19e5e8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:42 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD Jul 11 18:57:42 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:43 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1361933039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dfe2a0-61ad-465b-9a4e-7db350f7666e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbabc8aefb804f85a8d085c5ddb946eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:57:41Z,use_quota=True,user_id='615c0acb4f71440d96f8e0a472d7db29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Creating volume 52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:57:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:57:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:43 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e 1073741824 Jul 11 18:57:43 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:44 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e 1073741824" returned: 0 in 0.797s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:44 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:44 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:44 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 0 in 0.680s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:57:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:44 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Attempting download of 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}])) to volume 52dfe2a0-61ad-465b-9a4e-7db350f7666e. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:57:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[26883519-ca84-481c-a1a3-97ec3d7c20f6]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_2wpjqi9z {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:45 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_2wpjqi9z Jul 11 18:57:45 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:45 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_2wpjqi9z" returned: 0 in 0.733s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_2wpjqi9z {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:45 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_2wpjqi9z Jul 11 18:57:45 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:46 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_2wpjqi9z" returned: 1 in 0.717s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_2wpjqi9z' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:57:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e477c358-3453-4550-8839-e4bf604a0751]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:46 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD Jul 11 18:57:46 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:47 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD" returned: 0 in 0.705s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:47 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 was qcow2, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:57:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:47 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:47 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:48 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 0 in 1.711s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:48 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_7ms1urs1devstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:57:48 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Converted 112.00 MB image at 65.42 MB/s Jul 11 18:57:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:48 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e 1G Jul 11 18:57:48 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:49 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e 1G" returned: 0 in 0.654s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d26be9-6d3d-46a2-a6e7-a1a9e8a72c1f]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:49 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:49 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:50 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 0 in 0.720s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:50 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:50 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:50 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 1 in 0.728s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Downloaded image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}])) to volume 52dfe2a0-61ad-465b-9a4e-7db350f7666e successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Temporary image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 for user 615c0acb4f71440d96f8e0a472d7db29 is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Marking volume 52dfe2a0-61ad-465b-9a4e-7db350f7666e as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Copying metadata from image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 to 52dfe2a0-61ad-465b-9a4e-7db350f7666e. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:57:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Creating volume glance metadata for volume 52dfe2a0-61ad-465b-9a4e-7db350f7666e backed by image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:57:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16441cb-0999-4b54-9bd0-c2bf4cbf6a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff3a583-939a-4f52-a8b3-c47cd6bfe943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Volume volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e (52dfe2a0-61ad-465b-9a4e-7db350f7666e): created successfully Jul 11 18:57:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff3a583-939a-4f52-a8b3-c47cd6bfe943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Flow 'volume_create_manager' (dc526165-ab29-4f50-bbf4-236269741c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:57:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b921a5f5-05f6-4127-8f33-52073efe0754 tempest-VolumesExtendTest-1918135468 None] Created volume successfully. Jul 11 18:57:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7c5144-47e0-40f1-860d-8b01351aa8b6]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:52 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:52 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:52 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 0 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:52 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:52 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:53 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 1 in 0.739s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:57:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e 2G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e 2G" returned: 0 in 0.055s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.576s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-51af723e-b94e-4ee7-bc64-32a1db17c378 tempest-VolumesExtendTest-1918135468 None] Extend volume completed successfully. Jul 11 18:57:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Acquiring lock "cinder-52dfe2a0-61ad-465b-9a4e-7db350f7666e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:57:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-52dfe2a0-61ad-465b-9a4e-7db350f7666e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:57:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Acquiring lock "cinder-quobyte-52dfe2a0-61ad-465b-9a4e-7db350f7666e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:57:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-quobyte-52dfe2a0-61ad-465b-9a4e-7db350f7666e" acquired by "delete_volume" :: waited 0.012s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:57:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c278511-17ad-4bbc-8bd6-725e9916edf4]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:57:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:54 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:54 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:55 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 0 in 0.741s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:55 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:55 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:55 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 1 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:57:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:55 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e Jul 11 18:57:55 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:56 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-52dfe2a0-61ad-465b-9a4e-7db350f7666e" returned: 0 in 0.655s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-quobyte-52dfe2a0-61ad-465b-9a4e-7db350f7666e" released by "delete_volume" :: held 2.200s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Created reservations ['c582dc49-24c5-4d0d-b012-6da7f99c6c26', '61bbd5ba-5442-4e7d-b230-a2773a7bbcef', 'f05bbf91-a487-4ff1-a586-a384cabb4d5a', '47dce5fe-10de-489c-b1fc-0fb14a139909'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:56 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:57:56 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:57 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:57:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Deleted volume successfully. Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d32116d4-2b62-4328-a58e-38d2452ca79d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-52dfe2a0-61ad-465b-9a4e-7db350f7666e-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Flow 'volume_create_manager' (e16a018b-afd5-4d53-ab5f-b31180ffe8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3866f434-38a2-4400-a997-93b11c686739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3866f434-38a2-4400-a997-93b11c686739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1744486123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28887720-163a-4476-8b3c-be4d340850a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbabc8aefb804f85a8d085c5ddb946eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:57:58Z,use_quota=True,user_id='615c0acb4f71440d96f8e0a472d7db29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e77f91c-2bc0-4157-9cdf-680ce9cd647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e77f91c-2bc0-4157-9cdf-680ce9cd647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa280f5-1c2e-407f-9960-e6e9ec68c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa280f5-1c2e-407f-9960-e6e9ec68c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28887720-163a-4476-8b3c-be4d340850a4', 'volume_name': 'volume-28887720-163a-4476-8b3c-be4d340850a4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65cce7e-5243-4688-b801-0e9ede8aa18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65cce7e-5243-4688-b801-0e9ede8aa18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaa0222-84cc-486a-9022-01f614de973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Volume 28887720-163a-4476-8b3c-be4d340850a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28887720-163a-4476-8b3c-be4d340850a4', 'volume_size': 1} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1744486123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28887720-163a-4476-8b3c-be4d340850a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbabc8aefb804f85a8d085c5ddb946eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:57:58Z,use_quota=True,user_id='615c0acb4f71440d96f8e0a472d7db29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Creating volume 28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:57:57 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:57:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:58 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 1073741824 Jul 11 18:57:58 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:58 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 1073741824" returned: 0 in 0.794s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:58 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 Jul 11 18:57:58 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:59 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:57:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaa0222-84cc-486a-9022-01f614de973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28887720-163a-4476-8b3c-be4d340850a4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c29587a2-5f5a-498d-9dd2-5765879f962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:57:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Volume volume-28887720-163a-4476-8b3c-be4d340850a4 (28887720-163a-4476-8b3c-be4d340850a4): created successfully Jul 11 18:57:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c29587a2-5f5a-498d-9dd2-5765879f962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:57:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Flow 'volume_create_manager' (e16a018b-afd5-4d53-ab5f-b31180ffe8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:57:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-986abe9a-2af6-4341-adc3-79dacf508aed tempest-VolumesExtendTest-1918135468 None] Created volume successfully. Jul 11 18:58:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Creating offline snapshot de99f490-dc6f-4e41-8e50-63ab0d6dcad3 of volume 28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:58:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a6018-8554-45f5-9f30-95129567fabe]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:00 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 Jul 11 18:58:00 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:00 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4" returned: 0 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:00 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 1G Jul 11 18:58:00 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:01 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 1G" returned: 0 in 0.772s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28887720-163a-4476-8b3c-be4d340850a4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:01 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28887720-163a-4476-8b3c-be4d340850a4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 Jul 11 18:58:01 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:02 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28887720-163a-4476-8b3c-be4d340850a4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3" returned: 0 in 0.673s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:02 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 is being set with open permissions: ugo+rw Jul 11 18:58:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:02 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 Jul 11 18:58:02 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:03 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:03 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.info Jul 11 18:58:03 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:03 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.info" returned: 0 in 0.649s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:03 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.info is being set with open permissions: ugo+rw Jul 11 18:58:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:03 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.info Jul 11 18:58:03 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:04 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.info" returned: 0 in 0.634s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.196s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e207e786-7b02-4d4e-9d25-dee6086a7d8f tempest-VolumesExtendTest-1918135468 None] Create snapshot completed successfully Jul 11 18:58:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2df2ff74-0ba4-4481-9eac-839b9765bf05 tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2df2ff74-0ba4-4481-9eac-839b9765bf05 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e16f255-43e6-49c2-a11b-e2eb3e9ca0bf]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2df2ff74-0ba4-4481-9eac-839b9765bf05 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:05 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 Jul 11 18:58:05 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:06 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2df2ff74-0ba4-4481-9eac-839b9765bf05 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4" returned: 0 in 0.744s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2df2ff74-0ba4-4481-9eac-839b9765bf05 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 2G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2df2ff74-0ba4-4481-9eac-839b9765bf05 tempest-VolumesExtendTest-1918135468 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 2G" returned: 0 in 0.111s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2df2ff74-0ba4-4481-9eac-839b9765bf05 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.886s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2df2ff74-0ba4-4481-9eac-839b9765bf05 tempest-VolumesExtendTest-1918135468 None] Extend volume completed successfully. Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Acquiring lock "cinder-de99f490-dc6f-4e41-8e50-63ab0d6dcad3-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-de99f490-dc6f-4e41-8e50-63ab0d6dcad3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Acquiring lock "cinder-quobyte-28887720-163a-4476-8b3c-be4d340850a4" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-quobyte-28887720-163a-4476-8b3c-be4d340850a4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Acquiring lock "cinder-quobyte-de99f490-dc6f-4e41-8e50-63ab0d6dcad3" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-quobyte-de99f490-dc6f-4e41-8e50-63ab0d6dcad3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Deleting offline snapshot de99f490-dc6f-4e41-8e50-63ab0d6dcad3 of volume 28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] snapshot_file for this snap is: volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b151e77-2816-449d-a7ec-c5748538639e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:06 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 Jul 11 18:58:06 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:07 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3" returned: 0 in 0.752s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28887720-163a-4476-8b3c-be4d340850a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:58:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[162c7227-653b-477c-b360-03051803c265]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:07 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 Jul 11 18:58:07 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:08 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4" returned: 0 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:08 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 Jul 11 18:58:08 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:08 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3" returned: 0 in 0.748s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:08 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3 Jul 11 18:58:08 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:09 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4.de99f490-dc6f-4e41-8e50-63ab0d6dcad3" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-quobyte-de99f490-dc6f-4e41-8e50-63ab0d6dcad3" released by "_delete_snapshot" :: held 2.987s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-quobyte-28887720-163a-4476-8b3c-be4d340850a4" released by "delete_snapshot" :: held 3.010s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:09 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Created reservations ['092ba537-14dd-40ff-87ed-98b3ffc14792', 'e8c3bc41-45fa-45df-9788-7390c254e4fe', '0029d74e-fe83-4060-a521-288ff91b3464', '162cf0f9-1cfd-4e26-8a37-8b53358dd852'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Delete snapshot completed successfully. Jul 11 18:58:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0c5a119-4d48-467f-8e6b-ea389cb0728d tempest-VolumesExtendTest-1918135468 None] Lock "cinder-de99f490-dc6f-4e41-8e50-63ab0d6dcad3-delete_snapshot" released by "delete_snapshot" :: held 3.144s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Acquiring lock "cinder-28887720-163a-4476-8b3c-be4d340850a4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Lock "cinder-28887720-163a-4476-8b3c-be4d340850a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Acquiring lock "cinder-quobyte-28887720-163a-4476-8b3c-be4d340850a4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Lock "cinder-quobyte-28887720-163a-4476-8b3c-be4d340850a4" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e64460-a11c-4f52-8633-9a8f9e8b6f54]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:11 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 Jul 11 18:58:11 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:11 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4" returned: 0 in 0.736s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:11 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4 Jul 11 18:58:11 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:12 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-28887720-163a-4476-8b3c-be4d340850a4" returned: 0 in 0.637s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Lock "cinder-quobyte-28887720-163a-4476-8b3c-be4d340850a4" released by "delete_volume" :: held 1.427s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=39,cinder:UPDATE=35,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Created reservations ['ccdae6e9-38d5-4013-b482-f06cdb517360', 'b9745e3e-0382-483f-90f0-80092893d139', '56603cc1-d5b0-42e8-8704-b4a9169252c5', '787e50b0-295a-4d92-9d12-2c4474aa4a46'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:12 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:58:12 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:13 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.663s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:13 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Deleted volume successfully. Jul 11 18:58:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-29d8eda0-49af-4dd3-95fd-1e89235c7ae2 tempest-VolumesExtendTest-1918135468 None] Lock "cinder-28887720-163a-4476-8b3c-be4d340850a4-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:15 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:58:15 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (b84a267d-bc41-4a32-9663-fecaa3108366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2f652b-2c37-4022-ba98-c5c74778e354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=48,cinder:SELECT=44,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2f652b-2c37-4022-ba98-c5c74778e354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-362976443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa396029-c785-4687-a52a-5cf045c143c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:16Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092a8d0e-9791-411f-ba2e-faa5a886ef19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092a8d0e-9791-411f-ba2e-faa5a886ef19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e226af65-0f8f-4eb9-95ad-408119f319bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:15 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e226af65-0f8f-4eb9-95ad-408119f319bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa396029-c785-4687-a52a-5cf045c143c2', 'volume_name': 'volume-aa396029-c785-4687-a52a-5cf045c143c2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6344bb8f-740a-44d7-bf06-debe416d9031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6344bb8f-740a-44d7-bf06-debe416d9031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5678910d-9cb9-4f99-9d16-455612549c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Volume aa396029-c785-4687-a52a-5cf045c143c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa396029-c785-4687-a52a-5cf045c143c2', 'volume_size': 1} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-362976443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa396029-c785-4687-a52a-5cf045c143c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:16Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Creating volume aa396029-c785-4687-a52a-5cf045c143c2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:15 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.712s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:58:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:58:15 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 1073741824 Jul 11 18:58:15 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:16 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 1073741824" returned: 0 in 0.811s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:16 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 Jul 11 18:58:16 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:17 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2" returned: 0 in 0.627s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5678910d-9cb9-4f99-9d16-455612549c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa396029-c785-4687-a52a-5cf045c143c2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43eaa38d-c7c6-4c87-b489-c0ed90503ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Volume volume-aa396029-c785-4687-a52a-5cf045c143c2 (aa396029-c785-4687-a52a-5cf045c143c2): created successfully Jul 11 18:58:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43eaa38d-c7c6-4c87-b489-c0ed90503ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (b84a267d-bc41-4a32-9663-fecaa3108366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-780546b9-6f63-433e-b1d6-8df91d7a13fe tempest-VolumesGetTest-374218375 None] Created volume successfully. Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (8364e845-a9b9-4192-bd24-f229be9141eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba25008-1247-4bda-b1a2-71eb755e2dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba25008-1247-4bda-b1a2-71eb755e2dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773788677',display_name='tempest-VolumesGetTest-Volume-1026863766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a44300e-a6c9-46cd-a83e-4e09ab91386f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:18Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3022163-1465-4e8d-bcc9-799c8f308b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3022163-1465-4e8d-bcc9-799c8f308b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15e30b0-795b-4cd8-93ed-dc2d0bbcbffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15e30b0-795b-4cd8-93ed-dc2d0bbcbffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a44300e-a6c9-46cd-a83e-4e09ab91386f', 'volume_name': 'volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400c7fb2-be52-40a2-966b-ca3c150cfb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400c7fb2-be52-40a2-966b-ca3c150cfb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02709eb-926c-43cc-905d-afad10369f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Volume 7a44300e-a6c9-46cd-a83e-4e09ab91386f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f', 'volume_size': 1} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773788677',display_name='tempest-VolumesGetTest-Volume-1026863766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a44300e-a6c9-46cd-a83e-4e09ab91386f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:18Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Creating volume 7a44300e-a6c9-46cd-a83e-4e09ab91386f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:18 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:58:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:18 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f 1073741824 Jul 11 18:58:18 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:19 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f 1073741824" returned: 0 in 0.784s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:19 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f Jul 11 18:58:19 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:19 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f" returned: 0 in 0.614s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02709eb-926c-43cc-905d-afad10369f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589899f2-1ac2-40f5-a70e-98cc2c2d58ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:19 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Volume volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f (7a44300e-a6c9-46cd-a83e-4e09ab91386f): created successfully Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589899f2-1ac2-40f5-a70e-98cc2c2d58ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (8364e845-a9b9-4192-bd24-f229be9141eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9014aa44-f8a0-494d-8a7e-52ed8a5f15de tempest-VolumesGetTest-374218375 None] Created volume successfully. Jul 11 18:58:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-7a44300e-a6c9-46cd-a83e-4e09ab91386f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Lock "cinder-7a44300e-a6c9-46cd-a83e-4e09ab91386f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-7a44300e-a6c9-46cd-a83e-4e09ab91386f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-7a44300e-a6c9-46cd-a83e-4e09ab91386f" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dfbd25-60d1-4fad-ba44-7b7437d3f116]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:20 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f Jul 11 18:58:20 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:21 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f" returned: 0 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:21 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f Jul 11 18:58:21 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:22 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-7a44300e-a6c9-46cd-a83e-4e09ab91386f" returned: 0 in 0.652s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-7a44300e-a6c9-46cd-a83e-4e09ab91386f" released by "delete_volume" :: held 1.431s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Created reservations ['39100caf-ae05-42f8-b21c-2a701ee8c085', '7a4801dd-d7b2-4d93-be83-2e1d1971bff3', '0645c80f-86f9-41a7-bedf-2ced64a6dda8', 'd851daad-17c4-458f-8afd-27b137f0e411'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:22 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:58:22 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:22 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.624s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Deleted volume successfully. Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e206fdb5-cb90-4802-b331-d84fc555edc5 tempest-VolumesGetTest-374218375 None] Lock "cinder-7a44300e-a6c9-46cd-a83e-4e09ab91386f-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-aa396029-c785-4687-a52a-5cf045c143c2-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Lock "cinder-aa396029-c785-4687-a52a-5cf045c143c2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-aa396029-c785-4687-a52a-5cf045c143c2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-aa396029-c785-4687-a52a-5cf045c143c2" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5c90c-52c8-4fa4-8c76-686d2f3db7e3]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:23 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 Jul 11 18:58:23 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:23 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2" returned: 0 in 0.726s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:23 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2 Jul 11 18:58:23 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:24 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-aa396029-c785-4687-a52a-5cf045c143c2" returned: 0 in 0.658s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-aa396029-c785-4687-a52a-5cf045c143c2" released by "delete_volume" :: held 1.419s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Created reservations ['91a88f7d-0823-4c8c-93a0-2a3bc740969e', 'ec1d304d-d01d-4d5a-9267-31a35cd10933', '6cb7f475-0294-44d7-8269-7c6be4bd439a', '11ae34e4-62fb-4daa-b6aa-3152599f8912'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:24 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:58:24 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:25 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.668s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Deleted volume successfully. Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a3c6766-ba39-4159-afbe-d6eceefa4194 tempest-VolumesGetTest-374218375 None] Lock "cinder-aa396029-c785-4687-a52a-5cf045c143c2-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (f6221f64-a9df-46a2-b44b-4ff292e1ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd3208-58b0-43b9-ae37-84838a3219fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd3208-58b0-43b9-ae37-84838a3219fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1426207377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:25Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1e1766-0dc9-4332-9fe6-9dbaed690d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1e1766-0dc9-4332-9fe6-9dbaed690d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626b373c-e929-4831-bc98-cfaa08967171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626b373c-e929-4831-bc98-cfaa08967171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6', 'volume_name': 'volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7a52b9-0678-4831-a836-6218f341833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7a52b9-0678-4831-a836-6218f341833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0faa294f-0c83-4fbb-8916-990a08320e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Volume 9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6', 'volume_size': 1} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1426207377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:25Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Creating volume 9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:25 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:58:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:25 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 1073741824 Jul 11 18:58:25 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:26 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 1073741824" returned: 0 in 0.806s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:26 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 Jul 11 18:58:26 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:27 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" returned: 0 in 0.680s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0faa294f-0c83-4fbb-8916-990a08320e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d334f6-1be4-4484-be5f-c482e7d0a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:27 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Volume volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 (9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6): created successfully Jul 11 18:58:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d334f6-1be4-4484-be5f-c482e7d0a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (f6221f64-a9df-46a2-b44b-4ff292e1ec75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5822c6ba-650e-4ff4-8cec-128eb8656f0e tempest-VolumesGetTest-374218375 None] Created volume successfully. Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (1d750122-e225-44e7-a216-0e5e481a6881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1da56f-0d73-4e8f-90da-211f53504949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1da56f-0d73-4e8f-90da-211f53504949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1964678195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd39d00-634e-4067-926b-c23eb1981015,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:28Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f84dce-d61d-473b-a2b2-45672cce22f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f84dce-d61d-473b-a2b2-45672cce22f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339addfa-1170-4771-8e94-c8ed9aa71506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339addfa-1170-4771-8e94-c8ed9aa71506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cdd39d00-634e-4067-926b-c23eb1981015', 'volume_name': 'volume-cdd39d00-634e-4067-926b-c23eb1981015', 'volume_size': 1, 'source_volid': '9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6', 'source_volstatus': 'available'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1b9509-c970-4358-bbb5-af0844bb8582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1b9509-c970-4358-bbb5-af0844bb8582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de123eef-a95e-431c-9216-39c70ebab3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Volume cdd39d00-634e-4067-926b-c23eb1981015: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cdd39d00-634e-4067-926b-c23eb1981015', 'volume_size': 1, 'source_volid': '9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6', 'source_volstatus': 'available'} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:28 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Cloning volume 9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 to volume cdd39d00-634e-4067-926b-c23eb1981015 Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Creating offline snapshot 9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b of volume 9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af2e4b2-5520-4a7c-ac14-86d03c851c35]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:28 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 Jul 11 18:58:28 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:28 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" returned: 0 in 0.762s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:28 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b 1G Jul 11 18:58:28 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:29 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b 1G" returned: 0 in 0.782s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:29 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b Jul 11 18:58:29 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:30 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" returned: 0 in 0.690s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:30 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b is being set with open permissions: ugo+rw Jul 11 18:58:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:30 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b Jul 11 18:58:30 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:31 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" returned: 0 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:31 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.info Jul 11 18:58:31 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:31 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.info" returned: 0 in 0.659s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:31 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.info is being set with open permissions: ugo+rw Jul 11 18:58:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:31 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.info Jul 11 18:58:31 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:32 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.info" returned: 0 in 0.671s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-cdd39d00-634e-4067-926b-c23eb1981015" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-cdd39d00-634e-4067-926b-c23eb1981015" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] snapshot: 9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b, volume: cdd39d00-634e-4067-926b-c23eb1981015, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b559483e-2c0b-4556-803f-1f0eca6b3fb1]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:32 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b Jul 11 18:58:32 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:33 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" returned: 0 in 0.784s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:58:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:58:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:58:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ae64a1-aa02-4e4a-95d5-4050b88383ee]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:33 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 Jul 11 18:58:33 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:34 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" returned: 0 in 0.755s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:34 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:58:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:34 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 Jul 11 18:58:34 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:38 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015" returned: 0 in 4.300s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f606c2-5865-4d59-8040-e86d241af94b]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:38 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 Jul 11 18:58:38 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:39 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" returned: 0 in 0.910s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:58:39 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Converted 1024.00 MB image at 238.09 MB/s Jul 11 18:58:39 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 is being set with open permissions: ugo+rw Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:39 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 Jul 11 18:58:39 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:39 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015" returned: 0 in 0.636s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-cdd39d00-634e-4067-926b-c23eb1981015" released by "_copy_volume_from_snapshot" :: held 7.456s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Deleting offline snapshot 9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b of volume 9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] snapshot_file for this snap is: volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9503e3-3e68-4f04-9f35-4aaf346cd4ce]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:40 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b Jul 11 18:58:40 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:40 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:58:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25c6aef-98d9-4e1c-ad8b-7a65ee086b05]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:40 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 Jul 11 18:58:40 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:41 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=16,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:58:41 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" returned: 0 in 0.737s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:41 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b Jul 11 18:58:41 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:42 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" returned: 0 in 0.719s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:42 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b Jul 11 18:58:42 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:42 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6.9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-9b23c2aa-55b6-4c3e-9397-a0ef06c56e3b" released by "_delete_snapshot" :: held 2.915s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.769s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de123eef-a95e-431c-9216-39c70ebab3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd39d00-634e-4067-926b-c23eb1981015', 'volume_size': 1, 'source_volid': '9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6', 'source_volstatus': 'available'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d487a90-b89d-47a9-857c-d3403b3f3924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:42 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Volume volume-cdd39d00-634e-4067-926b-c23eb1981015 (cdd39d00-634e-4067-926b-c23eb1981015): created successfully Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d487a90-b89d-47a9-857c-d3403b3f3924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (1d750122-e225-44e7-a216-0e5e481a6881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e57b6deb-fc31-424b-8230-619527a92ddf tempest-VolumesGetTest-374218375 None] Created volume successfully. Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (dc34ffa8-1ed4-486e-8c13-819c77c813d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03652bc-10bc-4bf7-b575-8e6bf5b4c7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03652bc-10bc-4bf7-b575-8e6bf5b4c7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1284200853',display_name='tempest-VolumesGetTest-Volume-589458003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b718da-a9ae-45fd-9856-2beb8fc8e9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:44Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2990a1-68de-45e1-a840-5458f251119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2990a1-68de-45e1-a840-5458f251119f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb6977f-7958-4028-988f-07df2625475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb6977f-7958-4028-988f-07df2625475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b718da-a9ae-45fd-9856-2beb8fc8e9d2', 'volume_name': 'volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70c60f1-cd2d-4b08-ae39-b074d306eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70c60f1-cd2d-4b08-ae39-b074d306eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ed4081-524d-4ac5-b12c-c67c083c42be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Volume 47b718da-a9ae-45fd-9856-2beb8fc8e9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2', 'volume_size': 1} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1284200853',display_name='tempest-VolumesGetTest-Volume-589458003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b718da-a9ae-45fd-9856-2beb8fc8e9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:44Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Creating volume 47b718da-a9ae-45fd-9856-2beb8fc8e9d2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:58:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:43 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 1073741824 Jul 11 18:58:43 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:44 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 1073741824" returned: 0 in 0.798s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:44 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 Jul 11 18:58:44 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:45 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2" returned: 0 in 0.646s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ed4081-524d-4ac5-b12c-c67c083c42be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add36c5b-4377-4d37-b6aa-c14c5ac311eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Volume volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 (47b718da-a9ae-45fd-9856-2beb8fc8e9d2): created successfully Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add36c5b-4377-4d37-b6aa-c14c5ac311eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (dc34ffa8-1ed4-486e-8c13-819c77c813d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a4052ece-73c8-4a53-aa68-a99e1889ad3f tempest-VolumesGetTest-374218375 None] Created volume successfully. Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-47b718da-a9ae-45fd-9856-2beb8fc8e9d2-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Lock "cinder-47b718da-a9ae-45fd-9856-2beb8fc8e9d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-47b718da-a9ae-45fd-9856-2beb8fc8e9d2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-47b718da-a9ae-45fd-9856-2beb8fc8e9d2" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a885280-6ad2-431f-9c80-de19a38ab7df]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:46 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 Jul 11 18:58:46 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:46 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2" returned: 0 in 0.748s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:46 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2 Jul 11 18:58:46 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:47 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-47b718da-a9ae-45fd-9856-2beb8fc8e9d2" returned: 0 in 0.640s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-47b718da-a9ae-45fd-9856-2beb8fc8e9d2" released by "delete_volume" :: held 1.425s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Created reservations ['1b3087a9-a275-45a4-8d51-6d92a985c570', '94023caf-b603-4c05-a05e-bee888377355', '8aac6d9b-8e81-4fc6-89a6-af30204608f9', '1b036f23-04c3-4104-b43d-8e1c40087271'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:47 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:58:47 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:48 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.630s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Deleted volume successfully. Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a0a16d0f-50ed-4028-ae80-7a997139dc78 tempest-VolumesGetTest-374218375 None] Lock "cinder-47b718da-a9ae-45fd-9856-2beb8fc8e9d2-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-cdd39d00-634e-4067-926b-c23eb1981015-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Lock "cinder-cdd39d00-634e-4067-926b-c23eb1981015-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-cdd39d00-634e-4067-926b-c23eb1981015" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-cdd39d00-634e-4067-926b-c23eb1981015" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9791ccab-5cee-4592-aaee-94a535adf865]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:48 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 Jul 11 18:58:48 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:48 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015" returned: 0 in 0.731s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:48 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015 Jul 11 18:58:48 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:49 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cdd39d00-634e-4067-926b-c23eb1981015" returned: 0 in 0.645s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-cdd39d00-634e-4067-926b-c23eb1981015" released by "delete_volume" :: held 1.417s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Created reservations ['a0f244be-8746-42d9-9192-c2375260552b', '55261202-c8f1-49ae-9456-7dc342b1399b', 'faca9e67-15e3-4fff-b403-34af03a945b8', '6ca1449b-4b93-4d19-82b1-a9128b9aebff'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:49 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:58:49 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:50 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.661s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Deleted volume successfully. Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-66c6bff4-7799-4473-a890-9fdac6fdfc3a tempest-VolumesGetTest-374218375 None] Lock "cinder-cdd39d00-634e-4067-926b-c23eb1981015-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Lock "cinder-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f57c1-67ac-4c17-87b8-08e96a1e813e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:50 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 Jul 11 18:58:50 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:51 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" returned: 0 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:51 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6 Jul 11 18:58:51 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:51 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" returned: 0 in 0.644s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6" released by "delete_volume" :: held 1.436s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:51 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Created reservations ['9b3c985a-693c-4b5b-a45f-7e71ccd14efa', 'eddfa031-e5d1-4eee-b2ce-7e899e63a9bc', '4486b8bc-2f7f-4d4d-bf2a-d8045d9ac8f2', '2490bf84-ef11-43a4-9592-6a403ba56c7c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:52 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:58:52 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:52 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Deleted volume successfully. Jul 11 18:58:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7a9d836-8f78-4379-90be-1239eb503556 tempest-VolumesGetTest-374218375 None] Lock "cinder-9a4e1c6c-96d5-41e9-bfa7-9bcede6b34d6-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (f06682a6-1737-46e2-ae7b-ad23fbd21bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d13b8b-2758-4569-ae40-1e8d0a93fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d13b8b-2758-4569-ae40-1e8d0a93fc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-936736744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a1cf39-9ab9-4bd9-bc20-76eb9269c494,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:53Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abf2296-a0cc-4a2c-acbe-ac9ce7ec100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abf2296-a0cc-4a2c-acbe-ac9ce7ec100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073a83b5-a7ff-416c-a62e-e46969e1ce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073a83b5-a7ff-416c-a62e-e46969e1ce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02a1cf39-9ab9-4bd9-bc20-76eb9269c494', 'volume_name': 'volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581f96bc-bb04-4080-8493-0783e5b2ef62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581f96bc-bb04-4080-8493-0783e5b2ef62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136ad4e7-ba36-4913-a69e-ee97884664ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:53 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Volume 02a1cf39-9ab9-4bd9-bc20-76eb9269c494: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Trying to clone 02a1cf39-9ab9-4bd9-bc20-76eb9269c494 from image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:58:53 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:58:53 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:58:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edc8e89-237c-4223-8126-74d89e14fe08]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:54 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD Jul 11 18:58:54 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:54 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:54 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Temporary image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 is fetched for user 8ba1bf076792433c972ae4b2bf59c55e. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:58:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e76b2b-6df8-4c95-af03-c6170553d564]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:54 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD Jul 11 18:58:54 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:55 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-936736744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a1cf39-9ab9-4bd9-bc20-76eb9269c494,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:53Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Creating volume 02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:55 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:58:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:55 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 1073741824 Jul 11 18:58:55 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:56 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 1073741824" returned: 0 in 0.791s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:56 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 Jul 11 18:58:56 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:56 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" returned: 0 in 0.644s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:57 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Attempting download of 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}])) to volume 02a1cf39-9ab9-4bd9-bc20-76eb9269c494. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:58:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[859f4c14-b7a8-4b17-86ce-21d7aa9ff294]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_k06rf9_g {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:57 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_k06rf9_g Jul 11 18:58:57 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:57 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_k06rf9_g" returned: 0 in 0.716s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_k06rf9_g {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:57 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_k06rf9_g Jul 11 18:58:57 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:58 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_k06rf9_g" returned: 1 in 0.701s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_k06rf9_g' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:58:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dfbfce-178f-4d58-9fc7-5062e368793c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:58 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD Jul 11 18:58:58 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:59 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:59 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 was qcow2, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:58:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:59 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 Jul 11 18:58:59 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:00 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" returned: 0 in 1.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:00 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_d81h7knrdevstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:59:00 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Converted 112.00 MB image at 64.55 MB/s Jul 11 18:59:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:00 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 1G Jul 11 18:59:00 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:01 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 1G" returned: 0 in 0.678s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[909e6d34-31fd-429b-8d67-82ae27594edb]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:01 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 Jul 11 18:59:01 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:02 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" returned: 0 in 0.768s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:02 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 Jul 11 18:59:02 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:03 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" returned: 1 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Downloaded image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}])) to volume 02a1cf39-9ab9-4bd9-bc20-76eb9269c494 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Temporary image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 for user 8ba1bf076792433c972ae4b2bf59c55e is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Marking volume 02a1cf39-9ab9-4bd9-bc20-76eb9269c494 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Copying metadata from image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 to 02a1cf39-9ab9-4bd9-bc20-76eb9269c494. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Creating volume glance metadata for volume 02a1cf39-9ab9-4bd9-bc20-76eb9269c494 backed by image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136ad4e7-ba36-4913-a69e-ee97884664ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255ee939-a272-4d2a-ac8b-46f7872a0a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Volume volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 (02a1cf39-9ab9-4bd9-bc20-76eb9269c494): created successfully Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255ee939-a272-4d2a-ac8b-46f7872a0a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (f06682a6-1737-46e2-ae7b-ad23fbd21bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a333aba1-8534-41e1-ad37-322605213bdd tempest-VolumesGetTest-374218375 None] Created volume successfully. Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (ea1d4cd0-330b-4819-9bb1-46bddcfbc8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfda229-6e06-4b26-8e0c-14e5785b2f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfda229-6e06-4b26-8e0c-14e5785b2f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1994165266',display_name='tempest-VolumesGetTest-Volume-1357662621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34db6e65-d3e2-4458-8a53-c05ee5e5c82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:04Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7b32dd-f57c-4e20-9f64-86e1e155d353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7b32dd-f57c-4e20-9f64-86e1e155d353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7739389c-9cb5-489b-ab6c-7e02c820db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7739389c-9cb5-489b-ab6c-7e02c820db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34db6e65-d3e2-4458-8a53-c05ee5e5c82d', 'volume_name': 'volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90691884-8201-407e-906b-699045dda684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90691884-8201-407e-906b-699045dda684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e240765-6d9d-4d63-afe0-704d5f3a68ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Volume 34db6e65-d3e2-4458-8a53-c05ee5e5c82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d', 'volume_size': 1} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1994165266',display_name='tempest-VolumesGetTest-Volume-1357662621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34db6e65-d3e2-4458-8a53-c05ee5e5c82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be05ffc05f9f49ef8e3a780d25286af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:04Z,use_quota=True,user_id='8ba1bf076792433c972ae4b2bf59c55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Creating volume 34db6e65-d3e2-4458-8a53-c05ee5e5c82d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:59:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:04 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d 1073741824 Jul 11 18:59:04 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:05 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d 1073741824" returned: 0 in 0.798s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:05 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d Jul 11 18:59:05 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:05 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e240765-6d9d-4d63-afe0-704d5f3a68ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91720a4b-8b0b-4b51-b61c-83abf578fdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Volume volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d (34db6e65-d3e2-4458-8a53-c05ee5e5c82d): created successfully Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91720a4b-8b0b-4b51-b61c-83abf578fdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Flow 'volume_create_manager' (ea1d4cd0-330b-4819-9bb1-46bddcfbc8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-270a7b85-7e3f-4b0a-ad64-d980fb1dcf04 tempest-VolumesGetTest-374218375 None] Created volume successfully. Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-34db6e65-d3e2-4458-8a53-c05ee5e5c82d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Lock "cinder-34db6e65-d3e2-4458-8a53-c05ee5e5c82d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-34db6e65-d3e2-4458-8a53-c05ee5e5c82d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-34db6e65-d3e2-4458-8a53-c05ee5e5c82d" acquired by "delete_volume" :: waited 0.012s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc38eae-1a34-4487-b8d4-b5bfd47b2c85]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:06 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d Jul 11 18:59:06 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:07 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d" returned: 0 in 0.756s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:07 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d Jul 11 18:59:07 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:08 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-34db6e65-d3e2-4458-8a53-c05ee5e5c82d" returned: 0 in 0.652s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-34db6e65-d3e2-4458-8a53-c05ee5e5c82d" released by "delete_volume" :: held 1.445s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Created reservations ['0b2b809b-4388-4495-b58c-cc34761d3e0a', '67d05408-16ca-4283-b1c0-e4408678a18b', '481a44f8-c0fc-4d98-be7f-0448d3477ef5', 'f30cc951-3ed3-464f-8cc3-987f04a7ca94'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:08 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:59:08 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:08 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.650s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Deleted volume successfully. Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-02a1cf39-9ab9-4bd9-bc20-76eb9269c494-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Lock "cinder-02a1cf39-9ab9-4bd9-bc20-76eb9269c494-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d7aa2310-e59b-43de-8d0f-80dd5fa12e99 tempest-VolumesGetTest-374218375 None] Lock "cinder-34db6e65-d3e2-4458-8a53-c05ee5e5c82d-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Acquiring lock "cinder-quobyte-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccc9b5c-4c14-490c-acbd-438fb3fd247f]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:09 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 Jul 11 18:59:09 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:09 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" returned: 0 in 0.736s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:09 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 Jul 11 18:59:09 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:10 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" returned: 1 in 0.777s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:59:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:10 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494 Jul 11 18:59:10 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:11 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" returned: 0 in 0.631s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Lock "cinder-quobyte-02a1cf39-9ab9-4bd9-bc20-76eb9269c494" released by "delete_volume" :: held 2.204s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Created reservations ['de76f488-92ec-46c0-a936-0b514f82ab2a', '6acc4d99-c93b-4e3b-8e1b-6d0b9193fe2e', '6c3db273-7a51-43b2-ae1c-24e1e889e499', '6fde915e-e270-40a9-9112-81c3008c374d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:11 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:59:11 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:11 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.640s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Deleted volume successfully. Jul 11 18:59:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2ef7fef-4fa7-4000-ad23-9f7a7a787ebb tempest-VolumesGetTest-374218375 None] Lock "cinder-02a1cf39-9ab9-4bd9-bc20-76eb9269c494-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:INSERT=25,cinder:UPDATE=87,cinder:SELECT=58,cinder:DELETE=6 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Flow 'volume_create_manager' (d1c8626a-5eac-452e-8125-4e0173aee29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a58df7d-9186-4ba2-8f85-62319b7d418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a58df7d-9186-4ba2-8f85-62319b7d418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-641792862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db975d5-c539-4d10-9afe-94fde8c380f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43894e52266c4f529f3b5a1fa2b09dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:15Z,use_quota=True,user_id='8267a6d9b791421ea59de751b23cdf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c6dabe-2192-4b98-8ca8-3ea49d84c799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c6dabe-2192-4b98-8ca8-3ea49d84c799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b289b17-c09e-430a-b6da-8eafd0a49d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b289b17-c09e-430a-b6da-8eafd0a49d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db975d5-c539-4d10-9afe-94fde8c380f4', 'volume_name': 'volume-5db975d5-c539-4d10-9afe-94fde8c380f4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1747d845-bb18-4078-8bf4-51af4740def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1747d845-bb18-4078-8bf4-51af4740def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c9a9db-b249-4132-aef6-2069f282bb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Volume 5db975d5-c539-4d10-9afe-94fde8c380f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db975d5-c539-4d10-9afe-94fde8c380f4', 'volume_size': 1} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-641792862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db975d5-c539-4d10-9afe-94fde8c380f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43894e52266c4f529f3b5a1fa2b09dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:15Z,use_quota=True,user_id='8267a6d9b791421ea59de751b23cdf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Creating volume 5db975d5-c539-4d10-9afe-94fde8c380f4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:14 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:59:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:14 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 1073741824 Jul 11 18:59:14 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:15 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:59:15 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:15 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.680s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:15 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 1073741824" returned: 0 in 0.829s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:15 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 Jul 11 18:59:15 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:16 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4" returned: 0 in 0.669s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c9a9db-b249-4132-aef6-2069f282bb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db975d5-c539-4d10-9afe-94fde8c380f4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7c8a56-e73f-40ff-95c7-1730bd4f3ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Volume volume-5db975d5-c539-4d10-9afe-94fde8c380f4 (5db975d5-c539-4d10-9afe-94fde8c380f4): created successfully Jul 11 18:59:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7c8a56-e73f-40ff-95c7-1730bd4f3ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Flow 'volume_create_manager' (d1c8626a-5eac-452e-8125-4e0173aee29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-89e8ca59-b343-4018-bb4b-3034cbec2559 tempest-VolumesNegativeTest-1457552894 None] Created volume successfully. Jul 11 18:59:26 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:59:26 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=54,cinder:INSERT=20,cinder:SELECT=48,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:59:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Acquiring lock "cinder-5db975d5-c539-4d10-9afe-94fde8c380f4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Lock "cinder-5db975d5-c539-4d10-9afe-94fde8c380f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Acquiring lock "cinder-quobyte-5db975d5-c539-4d10-9afe-94fde8c380f4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Lock "cinder-quobyte-5db975d5-c539-4d10-9afe-94fde8c380f4" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[af40d3d9-d460-495a-a4fe-96cfbeabb234]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:44 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 Jul 11 18:59:44 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:45 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4" returned: 0 in 0.753s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:45 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4 Jul 11 18:59:45 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:46 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5db975d5-c539-4d10-9afe-94fde8c380f4" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Lock "cinder-quobyte-5db975d5-c539-4d10-9afe-94fde8c380f4" released by "delete_volume" :: held 1.424s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Created reservations ['721f0e0c-9472-4a74-a014-d21329480db3', '81d19710-0000-4ec8-a059-015ef2861dd1', 'aa69ad0f-999b-42e4-a2e5-f9e55fcd6ea3', '1758a695-8fb0-4032-9a68-1c7c97e9b87b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:46 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 18:59:46 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:46 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.661s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Deleted volume successfully. Jul 11 18:59:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3ba576ad-60e9-4729-a002-a3ac3b71fd9b tempest-VolumesNegativeTest-1457552894 None] Lock "cinder-5db975d5-c539-4d10-9afe-94fde8c380f4-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Flow 'volume_create_manager' (b4f98e81-6231-4ec5-adea-efe2f3f0620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc94eaf-4889-40ba-afc0-192dc8a4264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc94eaf-4889-40ba-afc0-192dc8a4264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-299274882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acff67d6-c4c5-4772-a6b7-80b7344a0506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0823b66438324bfa8ceeb563f86b0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:49Z,use_quota=True,user_id='cbb485f396c042c788d6cd02a15765fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e96b4d-1573-413e-b3a3-fe28584df99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e96b4d-1573-413e-b3a3-fe28584df99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80267623-2d75-4276-8df6-38b6234d298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80267623-2d75-4276-8df6-38b6234d298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acff67d6-c4c5-4772-a6b7-80b7344a0506', 'volume_name': 'volume-acff67d6-c4c5-4772-a6b7-80b7344a0506', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7524c6a2-686b-4d04-a519-adc5e650881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7524c6a2-686b-4d04-a519-adc5e650881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb017cb-e3c0-47eb-9de1-5198d9608685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Volume acff67d6-c4c5-4772-a6b7-80b7344a0506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acff67d6-c4c5-4772-a6b7-80b7344a0506', 'volume_size': 1} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-299274882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acff67d6-c4c5-4772-a6b7-80b7344a0506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0823b66438324bfa8ceeb563f86b0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:49Z,use_quota=True,user_id='cbb485f396c042c788d6cd02a15765fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Creating volume acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 18:59:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:49 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 1073741824 Jul 11 18:59:49 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:50 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 1073741824" returned: 0 in 0.777s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:50 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 Jul 11 18:59:50 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:50 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506" returned: 0 in 0.641s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb017cb-e3c0-47eb-9de1-5198d9608685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acff67d6-c4c5-4772-a6b7-80b7344a0506', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591b28a6-8a17-477b-8738-a0e274c93978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Volume volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 (acff67d6-c4c5-4772-a6b7-80b7344a0506): created successfully Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591b28a6-8a17-477b-8738-a0e274c93978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Flow 'volume_create_manager' (b4f98e81-6231-4ec5-adea-efe2f3f0620a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-83cf5f49-a1d1-4cfc-bb89-09cf212fbfce tempest-VolumesSnapshotListTestJSON-132709655 None] Created volume successfully. Jul 11 18:59:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Creating offline snapshot a930c23c-668b-464d-97b1-d964ef377022 of volume acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:59:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c25484-0310-44c0-b30f-a440300667fd]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:51 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 Jul 11 18:59:51 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:52 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506" returned: 0 in 0.776s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:52 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 1G Jul 11 18:59:52 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:52 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 1G" returned: 0 in 0.770s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:53 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 Jul 11 18:59:53 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:53 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022" returned: 0 in 0.670s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:53 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 is being set with open permissions: ugo+rw Jul 11 18:59:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:53 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 Jul 11 18:59:53 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:54 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022" returned: 0 in 0.626s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:54 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.info Jul 11 18:59:54 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:54 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.info" returned: 0 in 0.632s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:54 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.info is being set with open permissions: ugo+rw Jul 11 18:59:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:54 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.info Jul 11 18:59:54 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:55 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.info" returned: 0 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.214s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5e2d463a-5230-42f8-9278-ebc7978e914f tempest-VolumesSnapshotListTestJSON-132709655 None] Create snapshot completed successfully Jul 11 18:59:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Creating offline snapshot 6b0782d6-dd7d-422e-95cd-643e832d0fd4 of volume acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:59:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f872a63-ea86-4618-8cda-fb66913390b0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:56 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 Jul 11 18:59:56 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:57 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022" returned: 0 in 0.748s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff67d6-c4c5-4772-a6b7-80b7344a0506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:59:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:57 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 1G Jul 11 18:59:57 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:58 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 1G" returned: 0 in 0.800s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:58 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 Jul 11 18:59:58 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:59 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:59 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 is being set with open permissions: ugo+rw Jul 11 18:59:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:59 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 Jul 11 18:59:59 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:59 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4" returned: 0 in 0.623s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6574cc24-97ab-46d5-87f9-a74c56fe9d6c tempest-VolumesSnapshotListTestJSON-132709655 None] Create snapshot completed successfully Jul 11 19:00:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Creating offline snapshot be8ff7a0-0d9d-4d11-86e2-27124e050b9f of volume acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:00:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[22711a3b-47ca-4f9e-88ff-569395a3f3b1]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:00 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 Jul 11 19:00:00 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:00 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4" returned: 0 in 0.757s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff67d6-c4c5-4772-a6b7-80b7344a0506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:00:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:00 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f 1G Jul 11 19:00:00 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:01 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f 1G" returned: 0 in 0.835s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:01 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f Jul 11 19:00:01 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:02 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f" returned: 0 in 0.682s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:02 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f is being set with open permissions: ugo+rw Jul 11 19:00:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:02 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f Jul 11 19:00:02 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:03 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.990s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4376726b-5ffc-40c0-a5ad-1527c7d56343 tempest-VolumesSnapshotListTestJSON-132709655 None] Create snapshot completed successfully Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-be8ff7a0-0d9d-4d11-86e2-27124e050b9f-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-be8ff7a0-0d9d-4d11-86e2-27124e050b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-quobyte-be8ff7a0-0d9d-4d11-86e2-27124e050b9f" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-be8ff7a0-0d9d-4d11-86e2-27124e050b9f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Deleting offline snapshot be8ff7a0-0d9d-4d11-86e2-27124e050b9f of volume acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] snapshot_file for this snap is: volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26d88a1-de75-4acf-8a33-d29c6aa84d8f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:04 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f Jul 11 19:00:04 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:04 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f" returned: 0 in 0.766s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff67d6-c4c5-4772-a6b7-80b7344a0506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:00:04 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb101b1-b867-4783-9a16-712cc07b6589]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:04 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 Jul 11 19:00:04 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:05 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4" returned: 0 in 0.753s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff67d6-c4c5-4772-a6b7-80b7344a0506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:00:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:05 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f Jul 11 19:00:05 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:06 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f" returned: 0 in 0.751s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:06 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f Jul 11 19:00:06 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:06 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.be8ff7a0-0d9d-4d11-86e2-27124e050b9f" returned: 0 in 0.630s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-be8ff7a0-0d9d-4d11-86e2-27124e050b9f" released by "_delete_snapshot" :: held 2.982s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" released by "delete_snapshot" :: held 3.002s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:06 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Created reservations ['8b45e947-3706-46e7-b5f5-52b4d0a3d5e8', 'f8989adc-2cea-49d6-bba4-60ee0df58091', '5971e795-3e32-4eb5-8eac-b8de4bcf6087', 'ab534b96-5e06-4a44-81c3-d06a72486e78'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:00:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Delete snapshot completed successfully. Jul 11 19:00:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-984b13c7-a83b-4e65-ba13-8e6eaee96c2f tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-be8ff7a0-0d9d-4d11-86e2-27124e050b9f-delete_snapshot" released by "delete_snapshot" :: held 3.133s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-6b0782d6-dd7d-422e-95cd-643e832d0fd4-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-6b0782d6-dd7d-422e-95cd-643e832d0fd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-quobyte-6b0782d6-dd7d-422e-95cd-643e832d0fd4" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-6b0782d6-dd7d-422e-95cd-643e832d0fd4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Deleting offline snapshot 6b0782d6-dd7d-422e-95cd-643e832d0fd4 of volume acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] snapshot_file for this snap is: volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[41088f40-ee59-4f52-bde3-d3c2b6811b62]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:08 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 Jul 11 19:00:08 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:08 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4" returned: 0 in 0.744s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff67d6-c4c5-4772-a6b7-80b7344a0506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d113e917-97ee-4c0b-b0f8-8e8612fcbb3c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:09 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 Jul 11 19:00:09 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:09 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022" returned: 0 in 0.799s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff67d6-c4c5-4772-a6b7-80b7344a0506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:00:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:09 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 Jul 11 19:00:09 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:10 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:10 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4 Jul 11 19:00:10 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:11 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.6b0782d6-dd7d-422e-95cd-643e832d0fd4" returned: 0 in 0.642s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-6b0782d6-dd7d-422e-95cd-643e832d0fd4" released by "_delete_snapshot" :: held 3.026s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" released by "delete_snapshot" :: held 3.048s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Created reservations ['ceac45b6-5306-4391-b6f0-a440665cdbc4', '25c09e54-2f7b-41fb-a6d4-aee252321643', '59c8d8f7-64df-4efa-a8ca-d8b9a4330d82', 'e6f454f5-b3fe-49fd-b40c-9e117a485a3c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:00:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Delete snapshot completed successfully. Jul 11 19:00:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-90dc6e74-00f6-4b03-91c4-75691d6a749b tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-6b0782d6-dd7d-422e-95cd-643e832d0fd4-delete_snapshot" released by "delete_snapshot" :: held 3.181s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-a930c23c-668b-464d-97b1-d964ef377022-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-a930c23c-668b-464d-97b1-d964ef377022-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-quobyte-a930c23c-668b-464d-97b1-d964ef377022" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-a930c23c-668b-464d-97b1-d964ef377022" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Deleting offline snapshot a930c23c-668b-464d-97b1-d964ef377022 of volume acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] snapshot_file for this snap is: volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[89da5316-65d3-4aed-bb2b-23979721d84a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:12 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 Jul 11 19:00:12 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:13 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022" returned: 0 in 0.781s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff67d6-c4c5-4772-a6b7-80b7344a0506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:00:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a08f54e-aea6-40e7-8b12-0a7930b87a12]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:13 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 Jul 11 19:00:13 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:13 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506" returned: 0 in 0.775s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:13 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 Jul 11 19:00:13 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:14 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022" returned: 0 in 0.716s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:14 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022 Jul 11 19:00:14 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:15 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:00:15 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:15 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506.a930c23c-668b-464d-97b1-d964ef377022" returned: 0 in 0.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-a930c23c-668b-464d-97b1-d964ef377022" released by "_delete_snapshot" :: held 3.009s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" released by "delete_snapshot" :: held 3.038s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Created reservations ['6a9ba5a0-d4ae-42ea-b970-1da07a3aec36', '5015e42f-194a-4a9f-ac27-194d5e446d99', '8d284289-f72b-4d3c-896f-da75dbd33a35', '8b8f6c3e-f27b-4ced-b234-10e4bc16ef98'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:00:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Delete snapshot completed successfully. Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca5d7143-96e4-4403-8a2e-4bfcbaac3f25 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-a930c23c-668b-464d-97b1-d964ef377022-delete_snapshot" released by "delete_snapshot" :: held 3.186s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:15 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.668s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:00:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:00:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-acff67d6-c4c5-4772-a6b7-80b7344a0506-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-acff67d6-c4c5-4772-a6b7-80b7344a0506-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4798ead2-f279-497b-b260-4a9b6b73dafe]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:16 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 Jul 11 19:00:16 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:17 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506" returned: 0 in 0.744s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:17 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506 Jul 11 19:00:17 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:18 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-acff67d6-c4c5-4772-a6b7-80b7344a0506" returned: 0 in 0.636s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-quobyte-acff67d6-c4c5-4772-a6b7-80b7344a0506" released by "delete_volume" :: held 1.437s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Created reservations ['cc20ebfb-df14-4d64-a3d5-4ae4d2817d5c', '46400a77-549b-4cdf-ba84-f0e94895e2b6', '3d1f503f-9fff-4446-9bfe-f4cdc3f7d208', '3e571ef1-696b-4166-8962-4cc69e3a7f48'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:18 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:00:18 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:18 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.645s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:00:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Deleted volume successfully. Jul 11 19:00:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-40eb9d21-d941-436d-ab77-910ee9703c00 tempest-VolumesSnapshotListTestJSON-132709655 None] Lock "cinder-acff67d6-c4c5-4772-a6b7-80b7344a0506-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:28 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=36,cinder:INSERT=12,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:00:28 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=45,cinder:SELECT=34,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Flow 'volume_create_manager' (aa39f078-000d-41f7-b52a-1c11752719a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e592b649-3f89-46bc-a9e6-cb6fc7b175f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e592b649-3f89-46bc-a9e6-cb6fc7b175f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-909608120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6b4b9d-16db-49d6-839d-13ed0d11edea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f9ffe9003c48a2a3d9ac269a04a506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:00:39Z,use_quota=True,user_id='7ad22cef64a84378be715e4507c70673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3911322e-08e4-4675-b74d-5129bed2c945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3911322e-08e4-4675-b74d-5129bed2c945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c371c3-6bfe-4c21-8fd5-948c659aef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c371c3-6bfe-4c21-8fd5-948c659aef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6b4b9d-16db-49d6-839d-13ed0d11edea', 'volume_name': 'volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65def72c-824e-4b24-bfc5-b5181751e561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65def72c-824e-4b24-bfc5-b5181751e561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1a160b-3748-4ce0-89ba-15cf8fe0dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Volume 5c6b4b9d-16db-49d6-839d-13ed0d11edea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea', 'volume_size': 1} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-909608120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6b4b9d-16db-49d6-839d-13ed0d11edea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f9ffe9003c48a2a3d9ac269a04a506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:00:39Z,use_quota=True,user_id='7ad22cef64a84378be715e4507c70673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Creating volume 5c6b4b9d-16db-49d6-839d-13ed0d11edea {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:00:38 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:00:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:38 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea 1073741824 Jul 11 19:00:38 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Flow 'volume_create_manager' (a862904c-6881-405e-89db-84e95fd6265c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a735901-dc21-4086-ae5c-08bf24bb3879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a735901-dc21-4086-ae5c-08bf24bb3879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-563793816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de265d0-97af-4fba-901d-7e6fece1ad43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f9ffe9003c48a2a3d9ac269a04a506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:00:39Z,use_quota=True,user_id='7ad22cef64a84378be715e4507c70673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebac7cb-c3be-4b6b-a279-2f0167c20a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebac7cb-c3be-4b6b-a279-2f0167c20a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3c87aa-618c-4ac8-8afe-d5396ea14feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3c87aa-618c-4ac8-8afe-d5396ea14feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de265d0-97af-4fba-901d-7e6fece1ad43', 'volume_name': 'volume-8de265d0-97af-4fba-901d-7e6fece1ad43', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3764aeb-e958-4de3-8c40-d2d2c0e03dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3764aeb-e958-4de3-8c40-d2d2c0e03dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656dcaf7-05ef-4a56-bac1-f342237a21cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:39 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Volume 8de265d0-97af-4fba-901d-7e6fece1ad43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de265d0-97af-4fba-901d-7e6fece1ad43', 'volume_size': 1} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:39 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea 1073741824" returned: 0 in 0.967s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:39 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea Jul 11 19:00:39 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:40 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-563793816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de265d0-97af-4fba-901d-7e6fece1ad43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f9ffe9003c48a2a3d9ac269a04a506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:00:39Z,use_quota=True,user_id='7ad22cef64a84378be715e4507c70673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Creating volume 8de265d0-97af-4fba-901d-7e6fece1ad43 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:00:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1a160b-3748-4ce0-89ba-15cf8fe0dfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eced399-7d6d-42bd-a736-4adff70aa94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:40 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 1073741824 Jul 11 19:00:40 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Volume volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea (5c6b4b9d-16db-49d6-839d-13ed0d11edea): created successfully Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eced399-7d6d-42bd-a736-4adff70aa94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Flow 'volume_create_manager' (aa39f078-000d-41f7-b52a-1c11752719a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:00:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4416ea4e-aca8-425b-b845-2a5cd69c683c tempest-TestServerVolumeAttachmentScenario-787691675 None] Created volume successfully. Jul 11 19:00:41 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 1073741824" returned: 0 in 0.874s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:41 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 Jul 11 19:00:41 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:41 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43" returned: 0 in 0.688s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:00:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656dcaf7-05ef-4a56-bac1-f342237a21cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de265d0-97af-4fba-901d-7e6fece1ad43', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452b4669-afc8-4095-87da-25f16e3976bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:42 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Volume volume-8de265d0-97af-4fba-901d-7e6fece1ad43 (8de265d0-97af-4fba-901d-7e6fece1ad43): created successfully Jul 11 19:00:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452b4669-afc8-4095-87da-25f16e3976bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Flow 'volume_create_manager' (a862904c-6881-405e-89db-84e95fd6265c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:00:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5b7b496b-66ad-4bcf-987a-ee037073de83 tempest-TestServerVolumeAttachmentScenario-787691675 None] Created volume successfully. Jul 11 19:00:52 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=2,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:00:52 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:15 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:01:15 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:15 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:01:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:01:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8ab585ab-f200-4aae-a60f-108f401c3b15 req-b02fc4c8-793d-4cea-9296-efd0d9dae8a1 tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8ab585ab-f200-4aae-a60f-108f401c3b15 req-b02fc4c8-793d-4cea-9296-efd0d9dae8a1 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1660c1-29a8-4f7d-9392-6ab467da9501]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-8ab585ab-f200-4aae-a60f-108f401c3b15 req-b02fc4c8-793d-4cea-9296-efd0d9dae8a1 tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:20 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea Jul 11 19:01:20 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:21 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-8ab585ab-f200-4aae-a60f-108f401c3b15 req-b02fc4c8-793d-4cea-9296-efd0d9dae8a1 tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea" returned: 0 in 0.770s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-8ab585ab-f200-4aae-a60f-108f401c3b15 req-b02fc4c8-793d-4cea-9296-efd0d9dae8a1 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-8ab585ab-f200-4aae-a60f-108f401c3b15 req-b02fc4c8-793d-4cea-9296-efd0d9dae8a1 tempest-TestServerVolumeAttachmentScenario-787691675 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '537dfe69-e95d-4b84-9de1-c93e59f63d57', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 19:01:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-8ab585ab-f200-4aae-a60f-108f401c3b15 req-b02fc4c8-793d-4cea-9296-efd0d9dae8a1 tempest-TestServerVolumeAttachmentScenario-787691675 None] attachment_update completed successfully. Jul 11 19:01:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-048c8ecb-0dbf-4bad-825a-3a8054e01470 req-f49d21bd-a5ef-4729-a51c-a2c03012da40 tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-048c8ecb-0dbf-4bad-825a-3a8054e01470 req-f49d21bd-a5ef-4729-a51c-a2c03012da40 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305cff6-4f16-48b8-82d3-d78c1bf75cb4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-048c8ecb-0dbf-4bad-825a-3a8054e01470 req-f49d21bd-a5ef-4729-a51c-a2c03012da40 tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:30 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 Jul 11 19:01:30 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:31 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-048c8ecb-0dbf-4bad-825a-3a8054e01470 req-f49d21bd-a5ef-4729-a51c-a2c03012da40 tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43" returned: 0 in 0.805s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-048c8ecb-0dbf-4bad-825a-3a8054e01470 req-f49d21bd-a5ef-4729-a51c-a2c03012da40 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.820s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-048c8ecb-0dbf-4bad-825a-3a8054e01470 req-f49d21bd-a5ef-4729-a51c-a2c03012da40 tempest-TestServerVolumeAttachmentScenario-787691675 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-8de265d0-97af-4fba-901d-7e6fece1ad43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50b037fc-8033-4964-a3ba-73fac9564773', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 19:01:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-048c8ecb-0dbf-4bad-825a-3a8054e01470 req-f49d21bd-a5ef-4729-a51c-a2c03012da40 tempest-TestServerVolumeAttachmentScenario-787691675 None] attachment_update completed successfully. Jul 11 19:01:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-02e815a2-befb-4e4c-bee0-f12c50f0e187 req-81485678-e263-42cd-8bba-79a45e825a0c tempest-TestServerVolumeAttachmentScenario-787691675 None] Terminate volume connection completed successfully. Jul 11 19:01:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-02e815a2-befb-4e4c-bee0-f12c50f0e187 req-81485678-e263-42cd-8bba-79a45e825a0c tempest-TestServerVolumeAttachmentScenario-787691675 None] Deleting attachment 50b037fc-8033-4964-a3ba-73fac9564773. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 19:01:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-5987616e-3e1b-44c0-8512-0c608881263c req-091ac7e6-d280-4150-bfda-9ab8ecb88d03 tempest-TestServerVolumeAttachmentScenario-787691675 None] Terminate volume connection completed successfully. Jul 11 19:01:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-5987616e-3e1b-44c0-8512-0c608881263c req-091ac7e6-d280-4150-bfda-9ab8ecb88d03 tempest-TestServerVolumeAttachmentScenario-787691675 None] Deleting attachment 537dfe69-e95d-4b84-9de1-c93e59f63d57. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 19:01:50 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=16,cinder:UPDATE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:01:50 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=6,cinder:SELECT=11 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:01:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "cinder-8de265d0-97af-4fba-901d-7e6fece1ad43-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "cinder-8de265d0-97af-4fba-901d-7e6fece1ad43-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "cinder-quobyte-8de265d0-97af-4fba-901d-7e6fece1ad43" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "cinder-quobyte-8de265d0-97af-4fba-901d-7e6fece1ad43" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[91604dd8-efb7-421e-bb9f-a5ed2ab3c29e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:51 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 Jul 11 19:01:51 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:51 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43" returned: 0 in 0.766s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:51 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43 Jul 11 19:01:51 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:52 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8de265d0-97af-4fba-901d-7e6fece1ad43" returned: 0 in 0.637s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "cinder-quobyte-8de265d0-97af-4fba-901d-7e6fece1ad43" released by "delete_volume" :: held 1.439s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Created reservations ['2f865b3b-e00e-44d4-b2c3-51beb33a160b', '5e188d2a-5b39-45dc-b236-a0aba236dc27', 'd0191bf2-05cb-4ba3-88bd-7932c81f40fd', '28953f1a-99e5-4185-850a-38d6aad535e7'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:52 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:01:52 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "cinder-5c6b4b9d-16db-49d6-839d-13ed0d11edea-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:53 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Deleted volume successfully. Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "cinder-5c6b4b9d-16db-49d6-839d-13ed0d11edea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-47853481-aef0-4e47-9c5d-c24d6233c0a6 tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "cinder-8de265d0-97af-4fba-901d-7e6fece1ad43-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "cinder-quobyte-5c6b4b9d-16db-49d6-839d-13ed0d11edea" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "cinder-quobyte-5c6b4b9d-16db-49d6-839d-13ed0d11edea" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[804832b7-77f8-4cb6-9d57-84c0f10e5f74]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:53 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea Jul 11 19:01:53 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:53 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea" returned: 0 in 0.744s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:53 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea Jul 11 19:01:53 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:54 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5c6b4b9d-16db-49d6-839d-13ed0d11edea" returned: 0 in 0.636s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "cinder-quobyte-5c6b4b9d-16db-49d6-839d-13ed0d11edea" released by "delete_volume" :: held 1.417s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Created reservations ['f8ef0781-1da8-49d2-9fd2-8a2bf5043386', '02f7a31f-288b-47a7-bcdf-84504cf94e34', '378877dc-9f69-4df8-a8da-022c6e50d3cd', 'f34df20c-9bcc-4926-b1a4-4034b6f609a1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:54 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:01:54 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:55 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:55 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Deleted volume successfully. Jul 11 19:01:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-86a3449c-3b53-49b1-bc2c-8b20965266ce tempest-TestServerVolumeAttachmentScenario-787691675 None] Lock "cinder-5c6b4b9d-16db-49d6-839d-13ed0d11edea-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:04 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:02:05 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=9,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:15 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:02:15 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:15 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.720s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:02:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Flow 'volume_create_manager' (97cf49d3-f1a5-438c-9ca3-9491e44f48ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eed4427-4ba6-4dfd-af58-13d0f31c7753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eed4427-4ba6-4dfd-af58-13d0f31c7753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1275932557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e727fd56-36b8-433f-8d41-10fc4ae69cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5bfe321bb7488d878943cfecb22251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:25Z,use_quota=True,user_id='89a5d7ed514e422196947f9f446e8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4697eaa-912d-4a91-b7cd-730dbe316298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4697eaa-912d-4a91-b7cd-730dbe316298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc63e4a5-31bd-4048-bd4f-4bd9d1fadb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc63e4a5-31bd-4048-bd4f-4bd9d1fadb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e727fd56-36b8-433f-8d41-10fc4ae69cb9', 'volume_name': 'volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f0bc4f-23bb-4e91-8803-9de9e498a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f0bc4f-23bb-4e91-8803-9de9e498a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38bb966-b023-4b1d-aa18-9244e41adad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Volume e727fd56-36b8-433f-8d41-10fc4ae69cb9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Trying to clone e727fd56-36b8-433f-8d41-10fc4ae69cb9 from image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 19:02:25 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Image download 20.69 MB at 20.69 MB/s Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0545b6a1-7674-4837-9c0f-1b00a36b0717]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:25 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD Jul 11 19:02:25 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:26 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:26 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Temporary image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 is fetched for user 89a5d7ed514e422196947f9f446e8e5b. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 19:02:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8f2bb9-cea3-4020-b22e-a53c7b1ecb18]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:26 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD Jul 11 19:02:26 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:27 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD" returned: 0 in 0.735s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1275932557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e727fd56-36b8-433f-8d41-10fc4ae69cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5bfe321bb7488d878943cfecb22251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:25Z,use_quota=True,user_id='89a5d7ed514e422196947f9f446e8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Creating volume e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:27 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:02:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:27 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 1073741824 Jul 11 19:02:27 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:28 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 1073741824" returned: 0 in 0.807s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:28 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:02:28 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:28 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:02:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:28 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Attempting download of 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}])) to volume e727fd56-36b8-433f-8d41-10fc4ae69cb9. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 19:02:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[16269ed6-a41f-4a5a-924f-1dddd54d26f4]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_s7_t02tc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:28 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_s7_t02tc Jul 11 19:02:28 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:29 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_s7_t02tc" returned: 0 in 0.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_s7_t02tc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:29 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_s7_t02tc Jul 11 19:02:29 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:30 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_s7_t02tc" returned: 1 in 0.725s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_s7_t02tc' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e63c72-5b8a-411b-b13f-69f758f9ace2]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:30 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD Jul 11 19:02:30 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:30 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD" returned: 0 in 0.699s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:30 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 was qcow2, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 19:02:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:30 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:02:30 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:32 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 0 in 1.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:32 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1bc04bc9-4fbd-4c54-a89e-81be8beaf637_ntzv4t18devstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:02:32 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Converted 112.00 MB image at 65.48 MB/s Jul 11 19:02:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:32 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 1G Jul 11 19:02:32 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:33 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 1G" returned: 0 in 0.671s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de67bc3-d5f8-48b7-83d4-262ede3e01be]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:33 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:02:33 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:34 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 0 in 0.732s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:34 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:02:34 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:34 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 1 in 0.754s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Downloaded image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}])) to volume e727fd56-36b8-433f-8d41-10fc4ae69cb9 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Temporary image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 for user 89a5d7ed514e422196947f9f446e8e5b is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Marking volume e727fd56-36b8-433f-8d41-10fc4ae69cb9 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Copying metadata from image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 to e727fd56-36b8-433f-8d41-10fc4ae69cb9. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Creating volume glance metadata for volume e727fd56-36b8-433f-8d41-10fc4ae69cb9 backed by image 1bc04bc9-4fbd-4c54-a89e-81be8beaf637 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38bb966-b023-4b1d-aa18-9244e41adad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9', 'volume_size': 1, 'image_id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71d7b6dfb93442cfa3ed68425df3b974', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1bc04bc9-4fbd-4c54-a89e-81be8beaf637', 'created_at': datetime.datetime(2026, 7, 11, 16, 34, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 34, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bc04bc9-4fbd-4c54-a89e-81be8beaf637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d1f083-c238-49bc-a8c0-4f40b694f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Volume volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 (e727fd56-36b8-433f-8d41-10fc4ae69cb9): created successfully Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d1f083-c238-49bc-a8c0-4f40b694f49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Flow 'volume_create_manager' (97cf49d3-f1a5-438c-9ca3-9491e44f48ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e980defe-d4ee-45bc-b01e-eab352138887 tempest-TestShelveInstance-308603815 None] Created volume successfully. Jul 11 19:02:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7430a4a7-67ba-4797-9f57-6a5a16b0907e]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:42 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:02:42 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:43 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:43 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:02:43 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:44 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 1 in 0.744s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.575s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d9af692-adbd-45b9-afca-9c85397929d8', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 19:02:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-e9cccc75-4484-4460-bcb0-9568c62eb57a req-69745253-a565-4665-8f7f-0165760fe214 tempest-TestShelveInstance-308603815 None] attachment_update completed successfully. Jul 11 19:02:54 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:INSERT=9 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:02:54 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=18,cinder:INSERT=5,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:15 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:03:15 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:15 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.646s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:03:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:03:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-cfe8f88c-8b30-40f4-96d2-66e2909dd08e req-74ad9cc3-4408-4cc0-a1ae-d962a69ae729 tempest-TestShelveInstance-308603815 None] Terminate volume connection completed successfully. Jul 11 19:03:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-cfe8f88c-8b30-40f4-96d2-66e2909dd08e req-74ad9cc3-4408-4cc0-a1ae-d962a69ae729 tempest-TestShelveInstance-308603815 None] Deleting attachment 9d9af692-adbd-45b9-afca-9c85397929d8. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 19:03:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39c9b33-9c54-4e5f-9fc9-5b7019e1bd8d]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:25 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:03:25 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:26 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 0 in 0.752s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:26 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:03:26 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:26 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 1 in 0.745s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:03:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.536s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a', 'name': 'volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eed461d3-9e17-4986-990e-c148dc4fa0de', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 19:03:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-1926e578-7424-4e97-8f58-20f8e8d1c6d4 req-c4d4458f-afc1-451f-a7f6-0ba7e2f3b225 tempest-TestShelveInstance-308603815 None] attachment_update completed successfully. Jul 11 19:03:36 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:03:36 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:04:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-a1365b05-eb1d-4ed6-aa31-bc025dec15b5 tempest-TestShelveInstance-308603815 None] Terminate volume connection completed successfully. Jul 11 19:04:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-a1365b05-eb1d-4ed6-aa31-bc025dec15b5 tempest-TestShelveInstance-308603815 None] Deleting attachment eed461d3-9e17-4986-990e-c148dc4fa0de. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 19:04:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Acquiring lock "cinder-e727fd56-36b8-433f-8d41-10fc4ae69cb9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Lock "cinder-e727fd56-36b8-433f-8d41-10fc4ae69cb9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Acquiring lock "cinder-quobyte-e727fd56-36b8-433f-8d41-10fc4ae69cb9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Lock "cinder-quobyte-e727fd56-36b8-433f-8d41-10fc4ae69cb9" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c36a1-0115-4db4-bc29-675e67c40a62]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:07 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:04:07 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:08 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 0 in 0.760s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:08 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:04:08 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:09 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 1 in 0.765s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:09 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9 Jul 11 19:04:09 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:09 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e727fd56-36b8-433f-8d41-10fc4ae69cb9" returned: 0 in 0.666s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Lock "cinder-quobyte-e727fd56-36b8-433f-8d41-10fc4ae69cb9" released by "delete_volume" :: held 2.258s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG cinder.quota [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Created reservations ['48939b3f-0d71-4bdc-a0ea-5de8ad0c98a1', '85f4643c-7a4c-4b3d-9488-401b78562244', 'a342f9f7-75eb-485e-add7-34f81a1a220d', '1a7b121e-7265-4f79-b1d9-25618428d83c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:09 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:04:09 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:10 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:10 devstack cinder-volume[87167]: DEBUG cinder.manager [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Deleted volume successfully. Jul 11 19:04:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-53df266d-7afe-4ac4-a850-e6c9dc1646c0 req-f5eec6ad-dd13-48e4-8015-2a0956edb092 tempest-TestShelveInstance-308603815 None] Lock "cinder-e727fd56-36b8-433f-8d41-10fc4ae69cb9-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:15 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:04:15 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:15 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.670s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:04:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:04:19 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (77175bb5-83c7-4989-aa2d-58bec2bbed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab617296-ae1d-4b84-b344-cb62a847d5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab617296-ae1d-4b84-b344-cb62a847d5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1146677600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c011a70-e8e8-409a-85ea-096fec11fcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:20Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff389e88-01b9-4743-922e-9be192b43bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff389e88-01b9-4743-922e-9be192b43bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1435ba7-86f1-4b03-9303-4bd7af0c285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1435ba7-86f1-4b03-9303-4bd7af0c285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c011a70-e8e8-409a-85ea-096fec11fcc6', 'volume_name': 'volume-9c011a70-e8e8-409a-85ea-096fec11fcc6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3efa864-8cf4-4fa2-b222-893c54637e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3efa864-8cf4-4fa2-b222-893c54637e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1a8413-a46f-4272-96d6-6e8dea14b161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume 9c011a70-e8e8-409a-85ea-096fec11fcc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c011a70-e8e8-409a-85ea-096fec11fcc6', 'volume_size': 1} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1146677600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c011a70-e8e8-409a-85ea-096fec11fcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:20Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Creating volume 9c011a70-e8e8-409a-85ea-096fec11fcc6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:20 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:20 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 1073741824 Jul 11 19:04:20 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:21 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 1073741824" returned: 0 in 0.801s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:21 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 Jul 11 19:04:21 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:21 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6" returned: 0 in 0.631s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1a8413-a46f-4272-96d6-6e8dea14b161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c011a70-e8e8-409a-85ea-096fec11fcc6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad616b5c-390f-47f3-bf2f-d8f2d8e9f21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 (9c011a70-e8e8-409a-85ea-096fec11fcc6): created successfully Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad616b5c-390f-47f3-bf2f-d8f2d8e9f21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (77175bb5-83c7-4989-aa2d-58bec2bbed94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4e6e991e-5b7f-4eb9-942b-4e0b68bda89d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created volume successfully. Jul 11 19:04:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Creating offline snapshot 88dc9af2-59fb-41e3-8c40-e8053a75cc4d of volume 9c011a70-e8e8-409a-85ea-096fec11fcc6 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:04:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9124efd9-c56d-472a-b3e4-695646c9f2cc]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:22 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 Jul 11 19:04:22 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:23 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6" returned: 0 in 0.764s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:23 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d 1G Jul 11 19:04:23 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:24 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d 1G" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:24 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d Jul 11 19:04:24 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:24 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:24 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d is being set with open permissions: ugo+rw Jul 11 19:04:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:24 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d Jul 11 19:04:24 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:25 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d" returned: 0 in 0.630s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:25 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.info Jul 11 19:04:25 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:26 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.info" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:26 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.info is being set with open permissions: ugo+rw Jul 11 19:04:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:26 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.info Jul 11 19:04:26 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:26 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.info" returned: 0 in 0.658s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.264s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-65cf493b-b9b1-4f58-a7bc-87584341b8c6 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Create snapshot completed successfully Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (ff5a404c-144b-41e4-83dd-549056ac2c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5880f945-8168-419d-b556-cf42ffaca8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5880f945-8168-419d-b556-cf42ffaca8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1588908213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:28Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b648a81c-4871-4fc8-b901-af430c5fb853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b648a81c-4871-4fc8-b901-af430c5fb853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b757875-3239-47b4-abd0-c09c2bfa4674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b757875-3239-47b4-abd0-c09c2bfa4674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928', 'volume_name': 'volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc390b7-05f6-43f0-b38c-100ca268dae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc390b7-05f6-43f0-b38c-100ca268dae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a463277-ef60-4c45-aaec-dcf3d538d48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume 6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928', 'volume_size': 1} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1588908213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:28Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Creating volume 6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:28 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:28 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 1073741824 Jul 11 19:04:28 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (1dfb0fc3-34dd-4569-958e-f023fb640d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cf74af-71ab-40e4-852c-1a66f966fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cf74af-71ab-40e4-852c-1a66f966fec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-562091910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7f815b-f109-4d4f-ad62-da7aff94d7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:28Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bcfee0-7245-496f-900a-9d6439e1168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bcfee0-7245-496f-900a-9d6439e1168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfce747b-b458-45e6-be45-6fb07b08f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfce747b-b458-45e6-be45-6fb07b08f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7f815b-f109-4d4f-ad62-da7aff94d7e5', 'volume_name': 'volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588aaea2-ca4b-4fbd-9d3f-3b10b386ca61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588aaea2-ca4b-4fbd-9d3f-3b10b386ca61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef91059-b4ce-4251-bf66-1290789203ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume de7f815b-f109-4d4f-ad62-da7aff94d7e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5', 'volume_size': 1} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (521c5b0a-a6fb-4656-91a0-44232ed7d63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8204422-0d95-4c99-8752-1415e57fe8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8204422-0d95-4c99-8752-1415e57fe8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-684807915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe809f20-6827-4ab5-9e7c-17deaee877ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:29Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4521eb0-0713-447d-ab7d-2a116213a4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4521eb0-0713-447d-ab7d-2a116213a4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2ea33b-da49-4e6f-9a6b-74021face580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2ea33b-da49-4e6f-9a6b-74021face580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe809f20-6827-4ab5-9e7c-17deaee877ff', 'volume_name': 'volume-fe809f20-6827-4ab5-9e7c-17deaee877ff', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77d1157-eaaa-4ccd-8806-b33bbe20b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77d1157-eaaa-4ccd-8806-b33bbe20b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556baf3c-9331-41f2-b548-be286b93b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume fe809f20-6827-4ab5-9e7c-17deaee877ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe809f20-6827-4ab5-9e7c-17deaee877ff', 'volume_size': 1} Jul 11 19:04:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:29 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 1073741824" returned: 0 in 0.932s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:29 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 Jul 11 19:04:29 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (77264d75-5f0a-404d-a32d-6abc39d9c42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0343d3-0562-49bc-a06b-9758f0b6bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0343d3-0562-49bc-a06b-9758f0b6bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632426036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b689df-a01b-4a70-9e70-86eb99ddeac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:29Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb5b018-2634-43ed-9179-0240b314adbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb5b018-2634-43ed-9179-0240b314adbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2851841b-954c-4d81-83b0-e16ba1fb3b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2851841b-954c-4d81-83b0-e16ba1fb3b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b689df-a01b-4a70-9e70-86eb99ddeac2', 'volume_name': 'volume-66b689df-a01b-4a70-9e70-86eb99ddeac2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49ed9a2-6c6d-476b-937a-43aed65d445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49ed9a2-6c6d-476b-937a-43aed65d445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3b775e-bc42-4f84-837f-ffb806d7e1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume 66b689df-a01b-4a70-9e70-86eb99ddeac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b689df-a01b-4a70-9e70-86eb99ddeac2', 'volume_size': 1} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (42a0c70a-4e4b-48a4-8196-392ec0b48aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d517e5d-1842-4b4f-a51a-78b4d420c8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d517e5d-1842-4b4f-a51a-78b4d420c8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295025509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014b3056-5be4-429f-9540-3eea2acd36f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:30Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c827e59-2347-4636-b77d-02c08938a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c827e59-2347-4636-b77d-02c08938a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecc03c1-717e-402e-8b1f-f26665554f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecc03c1-717e-402e-8b1f-f26665554f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '014b3056-5be4-429f-9540-3eea2acd36f4', 'volume_name': 'volume-014b3056-5be4-429f-9540-3eea2acd36f4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc754904-2c3f-4b71-b48e-eefc4dcafea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc754904-2c3f-4b71-b48e-eefc4dcafea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd42fd8-2c58-4cbb-9d51-4c56b560253f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume 014b3056-5be4-429f-9540-3eea2acd36f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-014b3056-5be4-429f-9540-3eea2acd36f4', 'volume_size': 1} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:29 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928" returned: 0 in 0.730s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-562091910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7f815b-f109-4d4f-ad62-da7aff94d7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:28Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Creating volume de7f815b-f109-4d4f-ad62-da7aff94d7e5 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:29 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:29 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 1073741824 Jul 11 19:04:29 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a463277-ef60-4c45-aaec-dcf3d538d48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c2b361-fc3c-4fdc-b507-7f3d20cf7b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 (6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928): created successfully Jul 11 19:04:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c2b361-fc3c-4fdc-b507-7f3d20cf7b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (ff5a404c-144b-41e4-83dd-549056ac2c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6154c5f9-5a60-4a1c-85e0-dc020e5e2506 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created volume successfully. Jul 11 19:04:30 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 1073741824" returned: 0 in 0.841s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:30 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 Jul 11 19:04:30 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:31 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5" returned: 0 in 0.636s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.487s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-684807915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe809f20-6827-4ab5-9e7c-17deaee877ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:29Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Creating volume fe809f20-6827-4ab5-9e7c-17deaee877ff {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef91059-b4ce-4251-bf66-1290789203ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8637e3d-5f40-4254-a8eb-3230c55b6410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:31 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff 1073741824 Jul 11 19:04:31 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 (de7f815b-f109-4d4f-ad62-da7aff94d7e5): created successfully Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8637e3d-5f40-4254-a8eb-3230c55b6410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (1dfb0fc3-34dd-4569-958e-f023fb640d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-29ad9ee6-21c2-4aae-b4fa-08f9fe3b1bb9 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created volume successfully. Jul 11 19:04:32 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff 1073741824" returned: 0 in 0.815s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:32 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff Jul 11 19:04:32 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:32 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff" returned: 0 in 0.633s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.617s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632426036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b689df-a01b-4a70-9e70-86eb99ddeac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:29Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Creating volume 66b689df-a01b-4a70-9e70-86eb99ddeac2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:32 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556baf3c-9331-41f2-b548-be286b93b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe809f20-6827-4ab5-9e7c-17deaee877ff', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:32 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 1073741824 Jul 11 19:04:32 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b6b15-2f19-46da-8330-5280640a029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume volume-fe809f20-6827-4ab5-9e7c-17deaee877ff (fe809f20-6827-4ab5-9e7c-17deaee877ff): created successfully Jul 11 19:04:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b6b15-2f19-46da-8330-5280640a029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (521c5b0a-a6fb-4656-91a0-44232ed7d63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-01d07e34-2a92-4d68-9f2e-739efe16278e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created volume successfully. Jul 11 19:04:33 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 1073741824" returned: 0 in 0.794s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:33 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 Jul 11 19:04:33 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:34 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2" returned: 0 in 0.625s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.663s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295025509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014b3056-5be4-429f-9540-3eea2acd36f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a3b3720f564eca95b3dfe66eb81caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:30Z,use_quota=True,user_id='919a508385aa4c79b18e6eb68dfe1d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Creating volume 014b3056-5be4-429f-9540-3eea2acd36f4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:34 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3b775e-bc42-4f84-837f-ffb806d7e1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b689df-a01b-4a70-9e70-86eb99ddeac2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:34 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 1073741824 Jul 11 19:04:34 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee721227-5fa8-4254-9e9d-f4aee7e0b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 (66b689df-a01b-4a70-9e70-86eb99ddeac2): created successfully Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee721227-5fa8-4254-9e9d-f4aee7e0b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (77264d75-5f0a-404d-a32d-6abc39d9c42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0b67fc78-a999-4f59-b3eb-a4e8fd859154 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created volume successfully. Jul 11 19:04:35 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 1073741824" returned: 0 in 0.832s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:35 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 Jul 11 19:04:35 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:35 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4" returned: 0 in 0.624s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd42fd8-2c58-4cbb-9d51-4c56b560253f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014b3056-5be4-429f-9540-3eea2acd36f4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9337ff4c-ed5e-4737-ae00-9a13244614d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Volume volume-014b3056-5be4-429f-9540-3eea2acd36f4 (014b3056-5be4-429f-9540-3eea2acd36f4): created successfully Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9337ff4c-ed5e-4737-ae00-9a13244614d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Flow 'volume_create_manager' (42a0c70a-4e4b-48a4-8196-392ec0b48aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2655ece2-516b-4375-9036-944a5d4eb38e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created volume successfully. Jul 11 19:04:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-014b3056-5be4-429f-9540-3eea2acd36f4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-014b3056-5be4-429f-9540-3eea2acd36f4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-quobyte-014b3056-5be4-429f-9540-3eea2acd36f4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-014b3056-5be4-429f-9540-3eea2acd36f4" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d2cc2b-307d-4551-9b07-11cb95b29cea]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:36 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 Jul 11 19:04:36 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:37 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4" returned: 0 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:37 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4 Jul 11 19:04:37 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:37 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-014b3056-5be4-429f-9540-3eea2acd36f4" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-014b3056-5be4-429f-9540-3eea2acd36f4" released by "delete_volume" :: held 1.413s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created reservations ['c9204443-7b1a-4fe7-bec6-363b6a3baa5a', 'f3a6219a-19df-442a-a5ea-dc4e00306073', '12548341-acf0-456f-a0bb-d9153cad7b3f', '4386f23e-0f29-40e4-b312-c14d24c49406'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:37 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:04:37 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:38 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-66b689df-a01b-4a70-9e70-86eb99ddeac2-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.631s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Deleted volume successfully. Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-66b689df-a01b-4a70-9e70-86eb99ddeac2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e42c517-9753-4daf-b785-93df3f085d80 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-014b3056-5be4-429f-9540-3eea2acd36f4-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-quobyte-66b689df-a01b-4a70-9e70-86eb99ddeac2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-66b689df-a01b-4a70-9e70-86eb99ddeac2" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96df104-7b9c-47bb-8104-d1d2ef61eb3e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:38 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 Jul 11 19:04:38 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:39 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2" returned: 0 in 0.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:39 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2 Jul 11 19:04:39 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:39 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-66b689df-a01b-4a70-9e70-86eb99ddeac2" returned: 0 in 0.632s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-66b689df-a01b-4a70-9e70-86eb99ddeac2" released by "delete_volume" :: held 1.401s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created reservations ['07c5cff2-81f5-46b1-8f04-b297d648331c', '175c2563-5ddd-4ad1-9a79-3444ddcf8feb', '18241323-acab-4473-85ed-77769e8a1939', '02bca20b-06a6-4d4e-9066-13dbed52f09f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:40 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:04:40 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:40 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.633s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Deleted volume successfully. Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-594dcdeb-8fe3-4f9f-ad93-6b34abaaa1a7 tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-66b689df-a01b-4a70-9e70-86eb99ddeac2-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-fe809f20-6827-4ab5-9e7c-17deaee877ff-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-fe809f20-6827-4ab5-9e7c-17deaee877ff-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-quobyte-fe809f20-6827-4ab5-9e7c-17deaee877ff" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-fe809f20-6827-4ab5-9e7c-17deaee877ff" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52ff961-4fa1-4383-b73d-e6958ee4f37c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:40 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff Jul 11 19:04:40 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:41 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff" returned: 0 in 0.737s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:41 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff Jul 11 19:04:41 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:42 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-fe809f20-6827-4ab5-9e7c-17deaee877ff" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-fe809f20-6827-4ab5-9e7c-17deaee877ff" released by "delete_volume" :: held 1.414s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created reservations ['000edc5c-1379-46e2-90f4-371e6ca9d134', 'd61cde6a-de97-4d98-9a68-83e2a31c0866', 'b85fe4f9-2543-4d8c-a27e-aa11629f5407', '6a0ab302-8691-49ab-91f7-7a0197d0d1af'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:42 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:04:42 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-de7f815b-f109-4d4f-ad62-da7aff94d7e5-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:42 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-de7f815b-f109-4d4f-ad62-da7aff94d7e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Deleted volume successfully. Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-524c42d8-f16f-44df-ad35-bdc2122a0d8d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-fe809f20-6827-4ab5-9e7c-17deaee877ff-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-quobyte-de7f815b-f109-4d4f-ad62-da7aff94d7e5" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-de7f815b-f109-4d4f-ad62-da7aff94d7e5" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4295bb7b-fb62-4658-8482-b14bf2240583]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:43 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 Jul 11 19:04:43 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:43 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5" returned: 0 in 0.731s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:43 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5 Jul 11 19:04:43 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:44 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-de7f815b-f109-4d4f-ad62-da7aff94d7e5" returned: 0 in 0.636s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-de7f815b-f109-4d4f-ad62-da7aff94d7e5" released by "delete_volume" :: held 1.402s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created reservations ['2712f620-40e2-4f11-9b3b-d3b0e56a403d', '3eda0d66-93aa-46b4-9541-13b6f7b9faf5', '8b4c479e-000b-4d47-9147-e2235ed3c4f7', '4b6a9f0c-f986-4de3-8f01-ab9f30a3db73'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:44 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:04:44 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:45 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Deleted volume successfully. Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-010788f3-f9ab-45bf-9ea0-d6b9d70a2d4e tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-de7f815b-f109-4d4f-ad62-da7aff94d7e5-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-quobyte-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[480e841d-5984-4579-92a0-e83e1f03fe1a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:45 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 Jul 11 19:04:45 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:45 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928" returned: 0 in 0.736s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:45 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928 Jul 11 19:04:45 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:46 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928" returned: 0 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928" released by "delete_volume" :: held 1.432s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created reservations ['02791fc0-a4b2-4559-aad5-fde7ec556b8b', '58171ac0-6dd1-4f38-9d21-3daef542d1c7', 'f3b1a69f-61d9-48a5-bf1d-b6ea6b51aa1d', '163163eb-a930-4ca6-bed9-c1d86c25540c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:46 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:04:46 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-88dc9af2-59fb-41e3-8c40-e8053a75cc4d-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-88dc9af2-59fb-41e3-8c40-e8053a75cc4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-quobyte-9c011a70-e8e8-409a-85ea-096fec11fcc6" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-9c011a70-e8e8-409a-85ea-096fec11fcc6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-quobyte-88dc9af2-59fb-41e3-8c40-e8053a75cc4d" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:47 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-88dc9af2-59fb-41e3-8c40-e8053a75cc4d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Deleting offline snapshot 88dc9af2-59fb-41e3-8c40-e8053a75cc4d of volume 9c011a70-e8e8-409a-85ea-096fec11fcc6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] snapshot_file for this snap is: volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.677s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Deleted volume successfully. Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[79037684-0058-438e-9d61-76e7e936ef5d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0cc76192-f814-4987-b3fd-20e345add3bc tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-6f3e37dc-a66f-4d5c-8bb1-66e6f76a7928-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:47 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d Jul 11 19:04:47 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:48 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d" returned: 0 in 0.766s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c011a70-e8e8-409a-85ea-096fec11fcc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:04:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a66bac-78ac-421f-8e36-013542efb8f6]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:48 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 Jul 11 19:04:48 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:48 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6" returned: 0 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:48 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d Jul 11 19:04:48 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:49 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d" returned: 0 in 0.721s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:49 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d Jul 11 19:04:49 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:50 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6.88dc9af2-59fb-41e3-8c40-e8053a75cc4d" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-88dc9af2-59fb-41e3-8c40-e8053a75cc4d" released by "_delete_snapshot" :: held 2.965s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-9c011a70-e8e8-409a-85ea-096fec11fcc6" released by "delete_snapshot" :: held 2.995s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created reservations ['97af35f6-8600-41ac-9916-e03880e16934', '3da9ae2d-da28-4838-afa5-b3aad91a7ca4', 'fc867666-2631-4c15-9279-8088d04997c1', '97b3b15d-e6b9-43e2-92fe-bff97c8e2329'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Delete snapshot completed successfully. Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-93194e52-be18-4054-96a6-f60f76436a0d tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-88dc9af2-59fb-41e3-8c40-e8053a75cc4d-delete_snapshot" released by "delete_snapshot" :: held 3.125s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-9c011a70-e8e8-409a-85ea-096fec11fcc6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-9c011a70-e8e8-409a-85ea-096fec11fcc6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "cinder-quobyte-9c011a70-e8e8-409a-85ea-096fec11fcc6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-9c011a70-e8e8-409a-85ea-096fec11fcc6" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ffc1e4-d333-4f9f-a51d-dc41ddee4aab]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:50 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 Jul 11 19:04:50 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:51 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6" returned: 0 in 0.733s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:51 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6 Jul 11 19:04:51 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:51 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c011a70-e8e8-409a-85ea-096fec11fcc6" returned: 0 in 0.624s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-quobyte-9c011a70-e8e8-409a-85ea-096fec11fcc6" released by "delete_volume" :: held 1.410s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Created reservations ['a13b2b77-9846-41f5-a2b6-81a8dc257f64', 'bf07e424-6d04-4cb3-96d8-9a8869e8cce9', '40d6a005-ae4a-4f12-be94-b753c6f8e4b5', '8b42c1a9-1f1c-4434-97d8-c077fa32c4e3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:52 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:04:52 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:52 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.631s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Deleted volume successfully. Jul 11 19:04:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ffc3a28c-d5b8-4429-8e36-b3c700fca05b tempest-CreateVolumesFromSnapshotTest-1848826834 None] Lock "cinder-9c011a70-e8e8-409a-85ea-096fec11fcc6-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (ee301ef7-0646-4d4b-a434-128338780aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1dfac8-e063-4510-9a38-9ee8746a5e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1dfac8-e063-4510-9a38-9ee8746a5e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519746318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82688aff-045c-43c3-934d-5c1ec1d215fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:55Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba65dd8-fbb9-4bcd-adc2-8bf3cbf12719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba65dd8-fbb9-4bcd-adc2-8bf3cbf12719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb66e347-e9e7-4132-ab97-21cc131cfe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb66e347-e9e7-4132-ab97-21cc131cfe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82688aff-045c-43c3-934d-5c1ec1d215fd', 'volume_name': 'volume-82688aff-045c-43c3-934d-5c1ec1d215fd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102b2da5-ddd0-4df2-bba7-bfe89f599f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102b2da5-ddd0-4df2-bba7-bfe89f599f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b5a3b1-1cf1-4984-bf5a-cabfad935592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume 82688aff-045c-43c3-934d-5c1ec1d215fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82688aff-045c-43c3-934d-5c1ec1d215fd', 'volume_size': 1} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519746318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82688aff-045c-43c3-934d-5c1ec1d215fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:55Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Creating volume 82688aff-045c-43c3-934d-5c1ec1d215fd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:55 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:55 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd 1073741824 Jul 11 19:04:55 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:56 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd 1073741824" returned: 0 in 0.813s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:56 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd Jul 11 19:04:56 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:56 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd" returned: 0 in 0.636s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b5a3b1-1cf1-4984-bf5a-cabfad935592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82688aff-045c-43c3-934d-5c1ec1d215fd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2730f2f4-c7f6-4df7-aaee-c915fa9d197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=59,cinder:UPDATE=86,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:04:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume volume-82688aff-045c-43c3-934d-5c1ec1d215fd (82688aff-045c-43c3-934d-5c1ec1d215fd): created successfully Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2730f2f4-c7f6-4df7-aaee-c915fa9d197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (ee301ef7-0646-4d4b-a434-128338780aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4e288da2-f87d-4baf-9aae-23898c3682e2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created volume successfully. Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (9a8b0382-c210-4585-a3e9-17033e6b3d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c516cf22-a996-4c32-ba6f-795112cc347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c516cf22-a996-4c32-ba6f-795112cc347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289547460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb35c2b-6123-4511-9e04-4f536b7d171f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:58Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d8d670-1761-4de4-bacc-3e0b4961718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d8d670-1761-4de4-bacc-3e0b4961718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3633ecd-6377-4fb6-94b3-99714eb6aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3633ecd-6377-4fb6-94b3-99714eb6aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb35c2b-6123-4511-9e04-4f536b7d171f', 'volume_name': 'volume-cfb35c2b-6123-4511-9e04-4f536b7d171f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff122ecd-4ba4-4754-a544-7fa51169ee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff122ecd-4ba4-4754-a544-7fa51169ee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42104f59-7af1-4a54-b047-694b0ab581ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume cfb35c2b-6123-4511-9e04-4f536b7d171f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb35c2b-6123-4511-9e04-4f536b7d171f', 'volume_size': 1} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289547460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb35c2b-6123-4511-9e04-4f536b7d171f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:58Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Creating volume cfb35c2b-6123-4511-9e04-4f536b7d171f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:57 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:57 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f 1073741824 Jul 11 19:04:57 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (46c98427-b255-497e-9bfe-787a08c6498e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f26d1e2-8a64-47db-9a42-f60f1cdb7cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f26d1e2-8a64-47db-9a42-f60f1cdb7cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-176121459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd290ba-5653-43eb-b52a-36937d23eecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:58Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ffc61e-7566-4fbd-b161-1fe3759466fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ffc61e-7566-4fbd-b161-1fe3759466fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2adda9-e491-4245-a91a-7783062e843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2adda9-e491-4245-a91a-7783062e843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd290ba-5653-43eb-b52a-36937d23eecd', 'volume_name': 'volume-bcd290ba-5653-43eb-b52a-36937d23eecd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327a23ff-b5c3-4aa8-b8a8-7de5e1ac741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327a23ff-b5c3-4aa8-b8a8-7de5e1ac741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76951c6-3777-4ce3-af92-375c479fb665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume bcd290ba-5653-43eb-b52a-36937d23eecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd290ba-5653-43eb-b52a-36937d23eecd', 'volume_size': 1} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (e0786a5b-8028-465d-bd93-aff0102c532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea76527-1920-4dc8-a811-7404586daae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea76527-1920-4dc8-a811-7404586daae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1919181058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5104c7d2-cc8d-4440-b280-2e491eeecfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:58Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce48c8d3-7837-4c0a-98cb-8037458f98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce48c8d3-7837-4c0a-98cb-8037458f98b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d7e7a1-db4c-4481-94dd-43d4ffb2d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d7e7a1-db4c-4481-94dd-43d4ffb2d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5104c7d2-cc8d-4440-b280-2e491eeecfb4', 'volume_name': 'volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ff77e9-9a13-493b-a84b-b6b150ba1392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ff77e9-9a13-493b-a84b-b6b150ba1392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7cb6ffc-33ce-4e95-a4e8-04005a361e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume 5104c7d2-cc8d-4440-b280-2e491eeecfb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4', 'volume_size': 1} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:58 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f 1073741824" returned: 0 in 0.907s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:58 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f Jul 11 19:04:58 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (3527b7b4-ea8d-4d5d-a6ae-9eab72f15049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc443c0e-2606-4bda-aed0-534fac749ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc443c0e-2606-4bda-aed0-534fac749ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1281534637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfc5555-f6dd-489b-b963-a05582ba03bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:59Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a774a664-c294-40b7-8d91-96e5b5ab2ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a774a664-c294-40b7-8d91-96e5b5ab2ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930abaca-a2ae-4605-86d4-7b8ab44e9b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930abaca-a2ae-4605-86d4-7b8ab44e9b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfc5555-f6dd-489b-b963-a05582ba03bc', 'volume_name': 'volume-ebfc5555-f6dd-489b-b963-a05582ba03bc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a8036e-bf1d-4e7d-9f39-32c98c989c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a8036e-bf1d-4e7d-9f39-32c98c989c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83057566-0ad9-4980-81dc-512b792f2483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume ebfc5555-f6dd-489b-b963-a05582ba03bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfc5555-f6dd-489b-b963-a05582ba03bc', 'volume_size': 1} Jul 11 19:04:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (07270913-7d05-4bce-b31b-2abdc3dde73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e63a28-5dd3-435c-877f-ab16649aa2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e63a28-5dd3-435c-877f-ab16649aa2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1613618431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30447c4b-a1bc-4618-8840-df6dcbacb9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:59Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12880b2-804c-4495-90fa-296ff4747a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12880b2-804c-4495-90fa-296ff4747a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4afaf9c-2b97-4bd2-9009-a9c50aea1d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4afaf9c-2b97-4bd2-9009-a9c50aea1d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30447c4b-a1bc-4618-8840-df6dcbacb9bd', 'volume_name': 'volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95285acd-7073-4bfe-aeff-dc44f9fe27c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95285acd-7073-4bfe-aeff-dc44f9fe27c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01ad718-48b0-485d-b98c-8061e70c0aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume 30447c4b-a1bc-4618-8840-df6dcbacb9bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd', 'volume_size': 1} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:59 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f" returned: 0 in 0.683s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.304s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-176121459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd290ba-5653-43eb-b52a-36937d23eecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:58Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Creating volume bcd290ba-5653-43eb-b52a-36937d23eecd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:59 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:59 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd 1073741824 Jul 11 19:04:59 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42104f59-7af1-4a54-b047-694b0ab581ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb35c2b-6123-4511-9e04-4f536b7d171f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd7adf5-46b2-478d-ad32-c680c3bd68f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume volume-cfb35c2b-6123-4511-9e04-4f536b7d171f (cfb35c2b-6123-4511-9e04-4f536b7d171f): created successfully Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd7adf5-46b2-478d-ad32-c680c3bd68f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (9a8b0382-c210-4585-a3e9-17033e6b3d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-aa23810d-1c48-4f41-860e-915dc4263906 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created volume successfully. Jul 11 19:05:00 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd 1073741824" returned: 0 in 0.825s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:00 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd Jul 11 19:05:00 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:00 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd" returned: 0 in 0.626s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.428s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1919181058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5104c7d2-cc8d-4440-b280-2e491eeecfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:58Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Creating volume 5104c7d2-cc8d-4440-b280-2e491eeecfb4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:00 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:05:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76951c6-3777-4ce3-af92-375c479fb665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd290ba-5653-43eb-b52a-36937d23eecd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:01 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 1073741824 Jul 11 19:05:01 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139ab675-3565-4544-ab48-3358e177dd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume volume-bcd290ba-5653-43eb-b52a-36937d23eecd (bcd290ba-5653-43eb-b52a-36937d23eecd): created successfully Jul 11 19:05:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139ab675-3565-4544-ab48-3358e177dd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (46c98427-b255-497e-9bfe-787a08c6498e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-abbfe5f8-fe5b-411a-8586-e48ea474d243 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created volume successfully. Jul 11 19:05:01 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 1073741824" returned: 0 in 0.815s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:01 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 Jul 11 19:05:01 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:02 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4" returned: 0 in 0.650s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.552s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1281534637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfc5555-f6dd-489b-b963-a05582ba03bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:59Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Creating volume ebfc5555-f6dd-489b-b963-a05582ba03bc {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:02 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:02 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc 1073741824 Jul 11 19:05:02 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7cb6ffc-33ce-4e95-a4e8-04005a361e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dab33e-a0d2-4c0c-8e8c-1103ed528a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 (5104c7d2-cc8d-4440-b280-2e491eeecfb4): created successfully Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dab33e-a0d2-4c0c-8e8c-1103ed528a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (e0786a5b-8028-465d-bd93-aff0102c532b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0544ff0b-d922-4dc9-9110-885f97bfdcfb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created volume successfully. Jul 11 19:05:03 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc 1073741824" returned: 0 in 0.806s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:03 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc Jul 11 19:05:03 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:03 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc" returned: 0 in 0.633s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.680s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1613618431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30447c4b-a1bc-4618-8840-df6dcbacb9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b2a8b809894e4cb13aff94451591ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:59Z,use_quota=True,user_id='e560f74b71a4433798762c7570943a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Creating volume 30447c4b-a1bc-4618-8840-df6dcbacb9bd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:03 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:05:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:04 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd 1073741824 Jul 11 19:05:04 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83057566-0ad9-4980-81dc-512b792f2483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfc5555-f6dd-489b-b963-a05582ba03bc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b94e6d2-482f-4eb4-86de-6c89496593fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume volume-ebfc5555-f6dd-489b-b963-a05582ba03bc (ebfc5555-f6dd-489b-b963-a05582ba03bc): created successfully Jul 11 19:05:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b94e6d2-482f-4eb4-86de-6c89496593fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (3527b7b4-ea8d-4d5d-a6ae-9eab72f15049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f9fddf60-cf9f-4441-b725-4ccd6e599d6b tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created volume successfully. Jul 11 19:05:04 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd 1073741824" returned: 0 in 0.796s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:04 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd Jul 11 19:05:04 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:05 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd" returned: 0 in 0.617s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01ad718-48b0-485d-b98c-8061e70c0aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de76d674-da7c-4485-811a-8fc69147b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Volume volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd (30447c4b-a1bc-4618-8840-df6dcbacb9bd): created successfully Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de76d674-da7c-4485-811a-8fc69147b635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Flow 'volume_create_manager' (07270913-7d05-4bce-b31b-2abdc3dde73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7c3a8182-425c-4e9d-b5c9-cb97887a5296 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created volume successfully. Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-30447c4b-a1bc-4618-8840-df6dcbacb9bd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-30447c4b-a1bc-4618-8840-df6dcbacb9bd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-quobyte-30447c4b-a1bc-4618-8840-df6dcbacb9bd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-30447c4b-a1bc-4618-8840-df6dcbacb9bd" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a35c568-7e1a-455d-9da3-0661ca2c6889]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:05 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd Jul 11 19:05:05 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:06 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd" returned: 0 in 0.756s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:06 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd Jul 11 19:05:06 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:07 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-30447c4b-a1bc-4618-8840-df6dcbacb9bd" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-30447c4b-a1bc-4618-8840-df6dcbacb9bd" released by "delete_volume" :: held 1.440s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created reservations ['d83b87ee-aa77-470c-9632-536d909bcbda', 'feb7f779-f724-4e4b-a3d8-dbe4e5f150d0', 'ed83d0fa-45ea-48a7-b852-720c982f1938', '75ca3959-ccd1-4380-b8aa-3ff8a7a3b037'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:07 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:07 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-ebfc5555-f6dd-489b-b963-a05582ba03bc-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-ebfc5555-f6dd-489b-b963-a05582ba03bc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:07 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:07 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Deleted volume successfully. Jul 11 19:05:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-quobyte-ebfc5555-f6dd-489b-b963-a05582ba03bc" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f476c8f-0bf2-432c-af63-f532658ae543 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-30447c4b-a1bc-4618-8840-df6dcbacb9bd-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-ebfc5555-f6dd-489b-b963-a05582ba03bc" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ba50a-5ff9-4f88-b5d6-8b04f6ca8f5f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:08 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc Jul 11 19:05:08 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:08 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:08 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc Jul 11 19:05:08 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:09 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ebfc5555-f6dd-489b-b963-a05582ba03bc" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-ebfc5555-f6dd-489b-b963-a05582ba03bc" released by "delete_volume" :: held 1.430s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created reservations ['1051c937-5a1f-4572-be67-f2daf4afda33', '42c60a99-6f22-4a86-b0d8-bc68d6b8c146', '1dd4eb7f-f144-4459-8b36-f235945cb2b2', '418734c7-9f3b-45ad-a458-76afea889167'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:09 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:09 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-5104c7d2-cc8d-4440-b280-2e491eeecfb4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-5104c7d2-cc8d-4440-b280-2e491eeecfb4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:10 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Deleted volume successfully. Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f9fe4db3-4c8b-4187-986e-b9e9a3c63460 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-ebfc5555-f6dd-489b-b963-a05582ba03bc-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-quobyte-5104c7d2-cc8d-4440-b280-2e491eeecfb4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-5104c7d2-cc8d-4440-b280-2e491eeecfb4" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4969a81a-340e-4235-b740-4bf1852bb7cc]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:10 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 Jul 11 19:05:10 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:11 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4" returned: 0 in 0.751s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:11 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4 Jul 11 19:05:11 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:11 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-5104c7d2-cc8d-4440-b280-2e491eeecfb4" returned: 0 in 0.626s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-5104c7d2-cc8d-4440-b280-2e491eeecfb4" released by "delete_volume" :: held 1.411s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created reservations ['81ff495e-213e-4d5f-b945-51dc45edf782', '4ef78448-70da-4197-a065-cacdb99dc024', '10a8a90a-98a2-4024-991b-3724592fda66', '81c4f788-f126-4113-b58e-c561f28f7c4b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:11 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:11 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-bcd290ba-5653-43eb-b52a-36937d23eecd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:12 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-bcd290ba-5653-43eb-b52a-36937d23eecd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Deleted volume successfully. Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-955c9199-f525-437a-a198-00d9e00ef2d2 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-5104c7d2-cc8d-4440-b280-2e491eeecfb4-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-quobyte-bcd290ba-5653-43eb-b52a-36937d23eecd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-bcd290ba-5653-43eb-b52a-36937d23eecd" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[799db2b6-8923-48af-8636-5b543b6fe6f5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:12 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd Jul 11 19:05:12 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:13 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd" returned: 0 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:13 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd Jul 11 19:05:13 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:13 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bcd290ba-5653-43eb-b52a-36937d23eecd" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-bcd290ba-5653-43eb-b52a-36937d23eecd" released by "delete_volume" :: held 1.406s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created reservations ['6451a45e-4e69-44bb-95ee-b564c207b702', '66d423c6-a0d8-43d2-b3d4-1abfe7058771', '19f86ff7-1c1d-445c-851b-5b07dae11bac', '5b09ad9a-bc7d-4c5f-a116-7351466c419c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:14 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:14 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-cfb35c2b-6123-4511-9e04-4f536b7d171f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:14 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.647s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-cfb35c2b-6123-4511-9e04-4f536b7d171f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Deleted volume successfully. Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-009dbc84-e06e-4464-8986-9f87e41d6a84 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-bcd290ba-5653-43eb-b52a-36937d23eecd-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-quobyte-cfb35c2b-6123-4511-9e04-4f536b7d171f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-cfb35c2b-6123-4511-9e04-4f536b7d171f" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d93aff-8353-4c70-a1c7-0e2650eaf544]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:14 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f Jul 11 19:05:14 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:15 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:15 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:15 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f" returned: 0 in 0.733s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:15 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f Jul 11 19:05:15 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:15 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:05:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:05:16 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-cfb35c2b-6123-4511-9e04-4f536b7d171f" returned: 0 in 0.627s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-cfb35c2b-6123-4511-9e04-4f536b7d171f" released by "delete_volume" :: held 1.397s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created reservations ['4883146e-8a87-42b0-9d7b-96a5a0366800', 'c1e69faa-e7a5-4450-b31d-b8bcf99cf41c', '1e2d1dba-8ca9-4fba-8b36-2d77da06626f', '0809cce7-1f2e-4539-8ad7-e19804c4d650'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:16 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:16 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-82688aff-045c-43c3-934d-5c1ec1d215fd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-82688aff-045c-43c3-934d-5c1ec1d215fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:16 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.645s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Deleted volume successfully. Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-75c77464-3b56-423e-8c1a-04fc106e0128 tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-cfb35c2b-6123-4511-9e04-4f536b7d171f-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "cinder-quobyte-82688aff-045c-43c3-934d-5c1ec1d215fd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-82688aff-045c-43c3-934d-5c1ec1d215fd" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[14faada5-f51f-4e1e-9257-358d297c4ffa]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:17 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd Jul 11 19:05:17 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:17 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd" returned: 0 in 0.732s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:17 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd Jul 11 19:05:17 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:18 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-82688aff-045c-43c3-934d-5c1ec1d215fd" returned: 0 in 0.637s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-quobyte-82688aff-045c-43c3-934d-5c1ec1d215fd" released by "delete_volume" :: held 1.402s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Created reservations ['79a4f360-286a-473b-90a6-cdd752e30baa', '3da0f190-9988-4ea2-b5b9-71bc01d19cdd', '5ddb6166-dd42-4b5c-87c7-35b8dba04515', '83fd439b-6a37-4364-965c-4d7f6ae1e1da'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:18 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:18 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:19 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Deleted volume successfully. Jul 11 19:05:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8631861d-2a47-4073-a174-f22388318efb tempest-CreateVolumesFromSourceVolumeTest-2099149154 None] Lock "cinder-82688aff-045c-43c3-934d-5c1ec1d215fd-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=93,cinder:UPDATE=137,cinder:INSERT=34,cinder:DELETE=15 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Flow 'volume_create_manager' (29072b2c-7221-409a-b335-d22e39a21100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77844ad-0f1c-475c-9647-e6a845f0835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77844ad-0f1c-475c-9647-e6a845f0835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1188782063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cc1a69-989c-4fe5-9050-56217da7de43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800628dad81e4223b7699ceeeba925be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:22Z,use_quota=True,user_id='93942650d4a14e74b8c31a33f7891bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26bbcd1-15fa-4142-89ec-6c28a37b7dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26bbcd1-15fa-4142-89ec-6c28a37b7dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5010f74-3fe3-4978-ad96-077a467eac8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5010f74-3fe3-4978-ad96-077a467eac8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cc1a69-989c-4fe5-9050-56217da7de43', 'volume_name': 'volume-f0cc1a69-989c-4fe5-9050-56217da7de43', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e337344-12a7-466e-a3f5-968e347ae759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e337344-12a7-466e-a3f5-968e347ae759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b8af85-30f3-4d15-bc8d-9a2c725a59a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Volume f0cc1a69-989c-4fe5-9050-56217da7de43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cc1a69-989c-4fe5-9050-56217da7de43', 'volume_size': 1} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1188782063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cc1a69-989c-4fe5-9050-56217da7de43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800628dad81e4223b7699ceeeba925be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:22Z,use_quota=True,user_id='93942650d4a14e74b8c31a33f7891bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Creating volume f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:21 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:05:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:21 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 1073741824 Jul 11 19:05:21 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:22 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 1073741824" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:22 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 Jul 11 19:05:22 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:23 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43" returned: 0 in 0.625s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b8af85-30f3-4d15-bc8d-9a2c725a59a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cc1a69-989c-4fe5-9050-56217da7de43', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80416ed0-42ff-43ae-8799-4befcab35171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Volume volume-f0cc1a69-989c-4fe5-9050-56217da7de43 (f0cc1a69-989c-4fe5-9050-56217da7de43): created successfully Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80416ed0-42ff-43ae-8799-4befcab35171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Flow 'volume_create_manager' (29072b2c-7221-409a-b335-d22e39a21100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6ff7bb39-b3ca-4a5b-aed9-923682683d90 tempest-VolumeDependencyTests-527737489 None] Created volume successfully. Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Creating offline snapshot a20b173d-a6ac-4c6c-9922-2fcd73d90da8 of volume f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[be50d64f-fd83-4e4c-9eec-d3a6a5a72725]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:23 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 Jul 11 19:05:24 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:24 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43" returned: 0 in 0.752s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:24 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 1G Jul 11 19:05:24 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:25 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 1G" returned: 0 in 0.792s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cc1a69-989c-4fe5-9050-56217da7de43 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:25 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cc1a69-989c-4fe5-9050-56217da7de43 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 Jul 11 19:05:25 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:26 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cc1a69-989c-4fe5-9050-56217da7de43 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8" returned: 0 in 0.670s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:26 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 is being set with open permissions: ugo+rw Jul 11 19:05:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:26 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 Jul 11 19:05:26 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:26 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8" returned: 0 in 0.633s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:26 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.info Jul 11 19:05:26 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:27 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.info" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:27 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.info is being set with open permissions: ugo+rw Jul 11 19:05:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:27 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.info Jul 11 19:05:27 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:28 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.info" returned: 0 in 0.628s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.211s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d61f7cc3-e14e-4e9b-8f53-89c22fc05035 tempest-VolumeDependencyTests-527737489 None] Create snapshot completed successfully Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Flow 'volume_create_manager' (c4db13ca-5180-48f3-9b0f-a70d8463ace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c87293-e43c-4fdb-bd43-222fe33eece1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c87293-e43c-4fdb-bd43-222fe33eece1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1553932824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa0bd38-23ce-4636-8644-b29772ff3b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800628dad81e4223b7699ceeeba925be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a20b173d-a6ac-4c6c-9922-2fcd73d90da8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:30Z,use_quota=True,user_id='93942650d4a14e74b8c31a33f7891bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12571641-e3a1-4527-958c-66d1cf5dffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12571641-e3a1-4527-958c-66d1cf5dffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f663c4e4-7fd1-4ea8-ab21-7d696ab73f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f663c4e4-7fd1-4ea8-ab21-7d696ab73f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'efa0bd38-23ce-4636-8644-b29772ff3b9c', 'volume_name': 'volume-efa0bd38-23ce-4636-8644-b29772ff3b9c', 'volume_size': 1, 'snapshot_id': 'a20b173d-a6ac-4c6c-9922-2fcd73d90da8'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a40de7-aad6-46cf-90a3-d5d0899957bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a40de7-aad6-46cf-90a3-d5d0899957bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea3efa7c-02b8-45e9-a73e-f4b34b39ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Volume efa0bd38-23ce-4636-8644-b29772ff3b9c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-efa0bd38-23ce-4636-8644-b29772ff3b9c', 'volume_size': 1, 'snapshot_id': 'a20b173d-a6ac-4c6c-9922-2fcd73d90da8'} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-quobyte-a20b173d-a6ac-4c6c-9922-2fcd73d90da8-efa0bd38-23ce-4636-8644-b29772ff3b9c" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-a20b173d-a6ac-4c6c-9922-2fcd73d90da8-efa0bd38-23ce-4636-8644-b29772ff3b9c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Creating volume efa0bd38-23ce-4636-8644-b29772ff3b9c from snapshot a20b173d-a6ac-4c6c-9922-2fcd73d90da8 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-quobyte-efa0bd38-23ce-4636-8644-b29772ff3b9c" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-efa0bd38-23ce-4636-8644-b29772ff3b9c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] snapshot: a20b173d-a6ac-4c6c-9922-2fcd73d90da8, volume: efa0bd38-23ce-4636-8644-b29772ff3b9c, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b60210f-2ede-4146-a103-27d7fedfc2a6]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:29 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 Jul 11 19:05:29 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:30 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0cc1a69-989c-4fe5-9050-56217da7de43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:05:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 19:05:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 19:05:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a6b59-6d58-4005-8867-bd89f4d5cd9a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:30 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 Jul 11 19:05:30 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:31 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43" returned: 0 in 0.764s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:31 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 19:05:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:31 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c Jul 11 19:05:31 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:35 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c" returned: 0 in 4.213s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f293826-d33c-4781-acaa-d10db7e59a66]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:35 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 Jul 11 19:05:35 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:36 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43" returned: 0 in 0.906s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:36 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:05:36 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Converted 1024.00 MB image at 242.99 MB/s Jul 11 19:05:36 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c is being set with open permissions: ugo+rw Jul 11 19:05:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:36 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c Jul 11 19:05:36 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:37 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c" returned: 0 in 0.642s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-efa0bd38-23ce-4636-8644-b29772ff3b9c" released by "_copy_volume_from_snapshot" :: held 7.360s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-a20b173d-a6ac-4c6c-9922-2fcd73d90da8-efa0bd38-23ce-4636-8644-b29772ff3b9c" released by "_create_volume_from_snapshot" :: held 7.388s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.402s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea3efa7c-02b8-45e9-a73e-f4b34b39ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa0bd38-23ce-4636-8644-b29772ff3b9c', 'volume_size': 1, 'snapshot_id': 'a20b173d-a6ac-4c6c-9922-2fcd73d90da8'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82b31dd-90a4-4da7-a93f-a678d50a5f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:37 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Volume volume-efa0bd38-23ce-4636-8644-b29772ff3b9c (efa0bd38-23ce-4636-8644-b29772ff3b9c): created successfully Jul 11 19:05:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82b31dd-90a4-4da7-a93f-a678d50a5f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Flow 'volume_create_manager' (c4db13ca-5180-48f3-9b0f-a70d8463ace9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e03fa06a-e658-4d92-bf6b-11365224301b tempest-VolumeDependencyTests-527737489 None] Created volume successfully. Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-a20b173d-a6ac-4c6c-9922-2fcd73d90da8-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-a20b173d-a6ac-4c6c-9922-2fcd73d90da8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-quobyte-f0cc1a69-989c-4fe5-9050-56217da7de43" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-f0cc1a69-989c-4fe5-9050-56217da7de43" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-quobyte-a20b173d-a6ac-4c6c-9922-2fcd73d90da8" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-a20b173d-a6ac-4c6c-9922-2fcd73d90da8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Deleting offline snapshot a20b173d-a6ac-4c6c-9922-2fcd73d90da8 of volume f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] snapshot_file for this snap is: volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfbb217-d571-442b-8ab8-f871d7638b75]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:38 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 Jul 11 19:05:38 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:39 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0cc1a69-989c-4fe5-9050-56217da7de43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:05:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8cb9d9-7489-4683-b576-e3d18e7b7ce6]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:39 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 Jul 11 19:05:39 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:39 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43" returned: 0 in 0.767s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:39 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 Jul 11 19:05:39 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:40 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8" returned: 0 in 0.730s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:40 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8 Jul 11 19:05:40 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:41 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43.a20b173d-a6ac-4c6c-9922-2fcd73d90da8" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-a20b173d-a6ac-4c6c-9922-2fcd73d90da8" released by "_delete_snapshot" :: held 2.960s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-f0cc1a69-989c-4fe5-9050-56217da7de43" released by "delete_snapshot" :: held 2.981s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Created reservations ['fc53bcac-5266-4aa6-8174-304967eebe65', '9dde7306-89c4-4471-988c-a1f9aa6c18d9', '4666ab8a-357a-49b9-9ad2-0b9e85d0ec4d', 'a3673a08-cb2f-41b2-a5a2-b4cff54a7643'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Delete snapshot completed successfully. Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9bdc955f-e391-4295-b4f8-beac8c8d1b24 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-a20b173d-a6ac-4c6c-9922-2fcd73d90da8-delete_snapshot" released by "delete_snapshot" :: held 3.107s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-f0cc1a69-989c-4fe5-9050-56217da7de43-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-f0cc1a69-989c-4fe5-9050-56217da7de43-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-quobyte-f0cc1a69-989c-4fe5-9050-56217da7de43" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-f0cc1a69-989c-4fe5-9050-56217da7de43" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7a4322-0476-493c-a24e-0aee55273d9f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:41 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 Jul 11 19:05:41 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:42 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43" returned: 0 in 0.732s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:42 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43 Jul 11 19:05:42 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:43 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f0cc1a69-989c-4fe5-9050-56217da7de43" returned: 0 in 0.631s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-f0cc1a69-989c-4fe5-9050-56217da7de43" released by "delete_volume" :: held 1.416s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Created reservations ['253acf36-6567-4493-aed4-6d3a41fbf847', '23ff5067-b910-4949-a11f-20d2a60cf2e4', '06fe929e-a5df-4224-af89-bbdfbf7acfb1', '13ac855a-fa82-48bb-bcb0-633a548f2207'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:43 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:43 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:43 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-efa0bd38-23ce-4636-8644-b29772ff3b9c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.640s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Deleted volume successfully. Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Lock "cinder-efa0bd38-23ce-4636-8644-b29772ff3b9c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4049968a-79c7-4a21-9dcc-d26e430f92e1 tempest-VolumeDependencyTests-527737489 None] Lock "cinder-f0cc1a69-989c-4fe5-9050-56217da7de43-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Acquiring lock "cinder-quobyte-efa0bd38-23ce-4636-8644-b29772ff3b9c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-efa0bd38-23ce-4636-8644-b29772ff3b9c" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2914bb1f-42f3-41c9-8781-da4fe8097f10]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:44 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c Jul 11 19:05:44 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:44 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c" returned: 0 in 0.728s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:44 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c Jul 11 19:05:44 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:45 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efa0bd38-23ce-4636-8644-b29772ff3b9c" returned: 0 in 0.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Lock "cinder-quobyte-efa0bd38-23ce-4636-8644-b29772ff3b9c" released by "delete_volume" :: held 1.407s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Created reservations ['752d5a5b-a7a8-4ddc-9c5a-4b16c02cf972', 'e6559460-52c7-42cb-9a0e-80e240abb157', '8fed8bfa-ea82-4dc2-a776-a849476ab3b8', '625057be-eebb-4479-a5ec-c61114069a7d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:45 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:45 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:46 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.642s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Deleted volume successfully. Jul 11 19:05:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d0e77229-6d5c-4792-955c-772b258b3d8f tempest-VolumeDependencyTests-527737489 None] Lock "cinder-efa0bd38-23ce-4636-8644-b29772ff3b9c-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Flow 'volume_create_manager' (b63b1bba-0367-494e-86e2-e21155cd959a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4f66b7-e0ea-4124-b9c3-8b2857abf8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4f66b7-e0ea-4124-b9c3-8b2857abf8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088317444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4246eca6-6423-42a5-9af8-0c6459cde41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8a1e18a0ff49caa6b27e60c4852cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:49Z,use_quota=True,user_id='022ff3b757d548718f9551b27a0b7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0392d4a-d187-4d06-92d8-333c5ac96796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0392d4a-d187-4d06-92d8-333c5ac96796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadfe793-1ce2-42db-95ba-9e9aa1d7e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadfe793-1ce2-42db-95ba-9e9aa1d7e443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4246eca6-6423-42a5-9af8-0c6459cde41b', 'volume_name': 'volume-4246eca6-6423-42a5-9af8-0c6459cde41b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56077a42-1644-4607-ad94-2b79658667bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56077a42-1644-4607-ad94-2b79658667bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa9c29e-3c52-4142-875a-2abc44f8ff37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Volume 4246eca6-6423-42a5-9af8-0c6459cde41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4246eca6-6423-42a5-9af8-0c6459cde41b', 'volume_size': 1} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088317444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4246eca6-6423-42a5-9af8-0c6459cde41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8a1e18a0ff49caa6b27e60c4852cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:49Z,use_quota=True,user_id='022ff3b757d548718f9551b27a0b7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Creating volume 4246eca6-6423-42a5-9af8-0c6459cde41b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:05:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:49 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b 1073741824 Jul 11 19:05:49 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:50 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b 1073741824" returned: 0 in 0.797s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:50 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b Jul 11 19:05:50 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:51 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b" returned: 0 in 0.631s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa9c29e-3c52-4142-875a-2abc44f8ff37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4246eca6-6423-42a5-9af8-0c6459cde41b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9807d57-e226-46d4-9255-35ff1977d2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Volume volume-4246eca6-6423-42a5-9af8-0c6459cde41b (4246eca6-6423-42a5-9af8-0c6459cde41b): created successfully Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9807d57-e226-46d4-9255-35ff1977d2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Flow 'volume_create_manager' (b63b1bba-0367-494e-86e2-e21155cd959a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b7392ca9-1372-4b92-8c41-c9291d4aab20 tempest-ProjectReaderTests-1604947592 None] Created volume successfully. Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "cinder-4246eca6-6423-42a5-9af8-0c6459cde41b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Lock "cinder-4246eca6-6423-42a5-9af8-0c6459cde41b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "cinder-quobyte-4246eca6-6423-42a5-9af8-0c6459cde41b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Lock "cinder-quobyte-4246eca6-6423-42a5-9af8-0c6459cde41b" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73b346d-f26f-4334-a110-e299e551c950]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:51 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b Jul 11 19:05:51 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:52 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b" returned: 0 in 0.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:52 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b Jul 11 19:05:52 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:53 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-4246eca6-6423-42a5-9af8-0c6459cde41b" returned: 0 in 0.637s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Lock "cinder-quobyte-4246eca6-6423-42a5-9af8-0c6459cde41b" released by "delete_volume" :: held 1.407s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Created reservations ['cbc474d5-c679-4ddb-a019-0c4d45bf1a9f', '4636e4a8-ef8e-452c-b5e0-6bbdd0774e06', '48e9d634-df3f-43b3-ba00-e2cb6fc01d13', 'a0bd525a-0a91-4a9f-8683-261f9563eebe'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:53 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:53 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:53 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Deleted volume successfully. Jul 11 19:05:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2154723f-0155-4295-88ed-28d3a6e88da2 tempest-ProjectReaderTests-1604947592 None] Lock "cinder-4246eca6-6423-42a5-9af8-0c6459cde41b-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Flow 'volume_create_manager' (4c2a07a3-0c66-4664-a520-016ab1e019b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17845987-5bff-4ee3-b706-159a672fdea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17845987-5bff-4ee3-b706-159a672fdea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300436842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f9463a-669f-453a-9bc3-2764d00fa1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8a1e18a0ff49caa6b27e60c4852cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:54Z,use_quota=True,user_id='022ff3b757d548718f9551b27a0b7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecc44da-6b8c-40fa-acf8-d8a8cfbfbb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecc44da-6b8c-40fa-acf8-d8a8cfbfbb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb28b01-c1ce-44d8-9e2f-ad45cf0402db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb28b01-c1ce-44d8-9e2f-ad45cf0402db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f9463a-669f-453a-9bc3-2764d00fa1b8', 'volume_name': 'volume-25f9463a-669f-453a-9bc3-2764d00fa1b8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebd972d-fde8-4ea1-91a8-352c6c9aeca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebd972d-fde8-4ea1-91a8-352c6c9aeca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2767898-b52d-47f3-9da4-149decdd7fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:54 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Volume 25f9463a-669f-453a-9bc3-2764d00fa1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f9463a-669f-453a-9bc3-2764d00fa1b8', 'volume_size': 1} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300436842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f9463a-669f-453a-9bc3-2764d00fa1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8a1e18a0ff49caa6b27e60c4852cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:54Z,use_quota=True,user_id='022ff3b757d548718f9551b27a0b7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Creating volume 25f9463a-669f-453a-9bc3-2764d00fa1b8 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:54 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:05:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:54 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 1073741824 Jul 11 19:05:54 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:55 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 1073741824" returned: 0 in 0.808s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:55 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 Jul 11 19:05:55 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:55 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8" returned: 0 in 0.626s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2767898-b52d-47f3-9da4-149decdd7fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f9463a-669f-453a-9bc3-2764d00fa1b8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c5d3fb-e658-4283-b0f7-b1b11baa5fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Volume volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 (25f9463a-669f-453a-9bc3-2764d00fa1b8): created successfully Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c5d3fb-e658-4283-b0f7-b1b11baa5fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Flow 'volume_create_manager' (4c2a07a3-0c66-4664-a520-016ab1e019b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6266c956-1ab1-4e85-9573-cf11dd8d3928 tempest-ProjectReaderTests-1604947592 None] Created volume successfully. Jul 11 19:05:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "cinder-25f9463a-669f-453a-9bc3-2764d00fa1b8-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Lock "cinder-25f9463a-669f-453a-9bc3-2764d00fa1b8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "cinder-quobyte-25f9463a-669f-453a-9bc3-2764d00fa1b8" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Lock "cinder-quobyte-25f9463a-669f-453a-9bc3-2764d00fa1b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fc265a-e091-405f-8922-afc085cfa046]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:56 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 Jul 11 19:05:56 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:57 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8" returned: 0 in 0.740s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:57 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8 Jul 11 19:05:57 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:57 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-25f9463a-669f-453a-9bc3-2764d00fa1b8" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Lock "cinder-quobyte-25f9463a-669f-453a-9bc3-2764d00fa1b8" released by "delete_volume" :: held 1.416s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:57 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=76,cinder:UPDATE=109,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Created reservations ['6f95879c-59a8-4c17-92c8-a21363589337', 'a5ac5d72-e6e0-4070-885e-965e3099c1c6', '9648db42-790f-444a-bdc0-8c6f8cb0aebb', '47535367-4f5f-45cd-bcc9-99d52ef5a505'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:58 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:05:58 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:58 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.655s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Deleted volume successfully. Jul 11 19:05:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-696bcfcb-573a-4fcc-875f-e50d62419c59 tempest-ProjectReaderTests-1604947592 None] Lock "cinder-25f9463a-669f-453a-9bc3-2764d00fa1b8-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:08 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=48,cinder:DELETE=6,cinder:SELECT=38,cinder:INSERT=12 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:06:08 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:INSERT=2,cinder:UPDATE=6,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (888d72b1-c7c3-4bf0-8156-34e9598642a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6a9ffb-6198-4d29-b155-80fd89ba2639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6a9ffb-6198-4d29-b155-80fd89ba2639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1946323324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1fe25b-7e08-464c-926d-b5fb834ffccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:11Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2805fd16-2503-489e-b210-be73e0503e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2805fd16-2503-489e-b210-be73e0503e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d36ec78-b35d-410e-8bf7-a4ddddad1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d36ec78-b35d-410e-8bf7-a4ddddad1f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1fe25b-7e08-464c-926d-b5fb834ffccf', 'volume_name': 'volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5441a722-2d2e-4d17-b4e2-f5c5944f7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5441a722-2d2e-4d17-b4e2-f5c5944f7824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62a9a88-7e16-433f-9c9c-eae138c8da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:10 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume 0d1fe25b-7e08-464c-926d-b5fb834ffccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf', 'volume_size': 1} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1946323324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1fe25b-7e08-464c-926d-b5fb834ffccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:11Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Creating volume 0d1fe25b-7e08-464c-926d-b5fb834ffccf {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:10 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:10 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf 1073741824 Jul 11 19:06:10 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (fb94c6b8-5763-46cf-872e-60f76f7f40a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f584b1-7941-4240-9527-3e4de483afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f584b1-7941-4240-9527-3e4de483afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229577969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3510683-9eac-4ece-979c-c73bb1aeb8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:11Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fbbaa1-d5fa-4ced-95c5-a597dd3e9e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fbbaa1-d5fa-4ced-95c5-a597dd3e9e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339e6c6e-586f-415c-a941-6328cd1b6a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339e6c6e-586f-415c-a941-6328cd1b6a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3510683-9eac-4ece-979c-c73bb1aeb8f0', 'volume_name': 'volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13525610-01f7-4b8d-845b-94b6fb4d20b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13525610-01f7-4b8d-845b-94b6fb4d20b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f309d295-adff-4226-bc64-287094671be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume d3510683-9eac-4ece-979c-c73bb1aeb8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0', 'volume_size': 1} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (29b375bd-0bb7-41e1-a9c4-1c9987799633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28eee016-8db4-4b25-ace2-c4dead21cc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28eee016-8db4-4b25-ace2-c4dead21cc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1294545629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873a973d-b64d-4091-bbf5-b259c1506530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:11Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de67bdf-a203-44f3-b560-d65c154adb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de67bdf-a203-44f3-b560-d65c154adb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d4368e-59fa-4423-900f-d567ffd61ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d4368e-59fa-4423-900f-d567ffd61ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873a973d-b64d-4091-bbf5-b259c1506530', 'volume_name': 'volume-873a973d-b64d-4091-bbf5-b259c1506530', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d370ac-c06b-403c-979f-2589c185fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d370ac-c06b-403c-979f-2589c185fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1587fc-2cb6-4d59-8a9e-f9c36d7e3eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Volume 873a973d-b64d-4091-bbf5-b259c1506530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873a973d-b64d-4091-bbf5-b259c1506530', 'volume_size': 1} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (f4678a52-f3b2-4990-a5f3-b2a39d2b4879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb984abc-55b8-4979-86a8-130288ad281d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb984abc-55b8-4979-86a8-130288ad281d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-796438212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c968beae-e64a-445e-8c55-a35707fa9092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:12Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7b4f0e-ebe9-43bc-b9ff-3a41de0fd1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7b4f0e-ebe9-43bc-b9ff-3a41de0fd1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850e2ee5-3281-407b-be31-c0c27439d8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:11 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850e2ee5-3281-407b-be31-c0c27439d8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c968beae-e64a-445e-8c55-a35707fa9092', 'volume_name': 'volume-c968beae-e64a-445e-8c55-a35707fa9092', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c07084-2a24-4907-be73-ba66510395b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c07084-2a24-4907-be73-ba66510395b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd0c1a9-151e-43ef-a2e4-187c535b743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Volume c968beae-e64a-445e-8c55-a35707fa9092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c968beae-e64a-445e-8c55-a35707fa9092', 'volume_size': 1} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf 1073741824" returned: 0 in 1.128s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:12 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf Jul 11 19:06:12 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (5acb7c19-8c07-4902-86c7-8a4826e82fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d33700-c921-4c0b-bf5d-f844481a4ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d33700-c921-4c0b-bf5d-f844481a4ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306479932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577468d9-18f9-4921-9d61-465a7c814e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:12Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4661673d-120b-41d2-92c3-3f38c4b3c1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4661673d-120b-41d2-92c3-3f38c4b3c1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948798f-3b74-4882-a088-f04414b8d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948798f-3b74-4882-a088-f04414b8d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577468d9-18f9-4921-9d61-465a7c814e9b', 'volume_name': 'volume-577468d9-18f9-4921-9d61-465a7c814e9b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb05b725-ba8d-4a00-bc35-6e5310941462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb05b725-ba8d-4a00-bc35-6e5310941462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd2c846-3fba-4ab1-887e-198e76c226ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Volume 577468d9-18f9-4921-9d61-465a7c814e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577468d9-18f9-4921-9d61-465a7c814e9b', 'volume_size': 1} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (4e6dcfa0-241a-4ee6-8266-8935d161c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c1635a-e311-4a56-8b07-c78d75fba382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c1635a-e311-4a56-8b07-c78d75fba382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585424911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:13Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab192b5-efe7-483e-9a0a-0ef2ddc1d1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab192b5-efe7-483e-9a0a-0ef2ddc1d1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89829feb-d5d0-4efe-8622-4a3022e32d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89829feb-d5d0-4efe-8622-4a3022e32d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8', 'volume_name': 'volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbce28b8-76ac-4122-963f-4d3920a96bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbce28b8-76ac-4122-963f-4d3920a96bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14fcb13-79cd-42d1-9560-b89a0079008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Volume bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8', 'volume_size': 1} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:12 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf" returned: 0 in 0.868s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.898s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229577969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3510683-9eac-4ece-979c-c73bb1aeb8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:11Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Creating volume d3510683-9eac-4ece-979c-c73bb1aeb8f0 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:12 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:12 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 1073741824 Jul 11 19:06:12 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62a9a88-7e16-433f-9c9c-eae138c8da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc3d43f-4c8a-41bf-b190-79815c69e822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf (0d1fe25b-7e08-464c-926d-b5fb834ffccf): created successfully Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc3d43f-4c8a-41bf-b190-79815c69e822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (888d72b1-c7c3-4bf0-8156-34e9598642a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-401ca9de-aeb6-49df-ad32-b25be883997c tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created volume successfully. Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (7af4ea6a-9894-41d4-84f2-99ab199e0583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7af7435-7c45-4dff-8c37-c171bf2b13d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7af7435-7c45-4dff-8c37-c171bf2b13d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1743715382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635e3ff2-a0f6-430f-8fb9-d162e52bc6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:13Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf46ec3-34fc-41f2-b676-ce7b834ad381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf46ec3-34fc-41f2-b676-ce7b834ad381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adf871d-d378-44bd-83ce-d0b3dc22a4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adf871d-d378-44bd-83ce-d0b3dc22a4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635e3ff2-a0f6-430f-8fb9-d162e52bc6a7', 'volume_name': 'volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b0fe3f-997b-4606-9de3-913977950cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b0fe3f-997b-4606-9de3-913977950cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef34ddc-600a-4bd0-915a-16d3c2cf858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Volume 635e3ff2-a0f6-430f-8fb9-d162e52bc6a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7', 'volume_size': 1} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:13 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 1073741824" returned: 0 in 0.964s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:13 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 Jul 11 19:06:13 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (2032e02e-d62e-4130-b3b3-618aad87e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e14c7e0-9654-41eb-8b4f-a12f3a987848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e14c7e0-9654-41eb-8b4f-a12f3a987848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072256912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b6383b-3181-4f27-a717-a5f8bc33a5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:14Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d62785d-469c-43b8-92b4-92ee192a7eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d62785d-469c-43b8-92b4-92ee192a7eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4253519a-2c1f-4264-8e78-eebfa9a0ac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4253519a-2c1f-4264-8e78-eebfa9a0ac00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b6383b-3181-4f27-a717-a5f8bc33a5db', 'volume_name': 'volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e759f1b-0e57-4ea6-b5a9-c0b6d74b97f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e759f1b-0e57-4ea6-b5a9-c0b6d74b97f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f73907b-cf86-4ea0-aa61-2b34e3ef5336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume c0b6383b-3181-4f27-a717-a5f8bc33a5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db', 'volume_size': 1} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:14 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0" returned: 0 in 0.864s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.333s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1294545629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873a973d-b64d-4091-bbf5-b259c1506530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:11Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Creating volume 873a973d-b64d-4091-bbf5-b259c1506530 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:14 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:14 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 1073741824 Jul 11 19:06:14 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f309d295-adff-4226-bc64-287094671be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fceab5-c6e1-4bc6-b6eb-395ae4404e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 (d3510683-9eac-4ece-979c-c73bb1aeb8f0): created successfully Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fceab5-c6e1-4bc6-b6eb-395ae4404e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (fb94c6b8-5763-46cf-872e-60f76f7f40a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (e69b98eb-0469-449e-ad61-80cc6ca75606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42e258d-3e41-4023-bd1f-4d76688721d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c0a9948d-f0c5-4d03-985f-ded97f781158 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created volume successfully. Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42e258d-3e41-4023-bd1f-4d76688721d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1968577077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4b6a25-e741-4ff9-a3e1-38b32d63608e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:15Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fae9ca6-4317-45d2-b257-bc28adb719dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fae9ca6-4317-45d2-b257-bc28adb719dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72b062b-c892-4d75-b564-cab3a87d9f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72b062b-c892-4d75-b564-cab3a87d9f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4b6a25-e741-4ff9-a3e1-38b32d63608e', 'volume_name': 'volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bbb8e4-3595-4e14-ae0b-f34a958db9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bbb8e4-3595-4e14-ae0b-f34a958db9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54ca2a0-89ef-4999-8ff5-ab3f9c329896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume ba4b6a25-e741-4ff9-a3e1-38b32d63608e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e', 'volume_size': 1} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:15 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:15 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:16 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 1073741824" returned: 0 in 1.292s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:16 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (49a3c1fa-d0db-44f7-b274-893e545fffae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330897e1-ecbb-4cb8-b73b-90aa4adb2382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.086s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Flow 'volume_create_manager' (fefeb7ed-cd4c-4e7a-98c0-87341570d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ce821b-90d5-453c-816a-1b6b6846b7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330897e1-ecbb-4cb8-b73b-90aa4adb2382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-947629268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f77996-b30d-4f14-8492-1f56914a20d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:16Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2484248a-cf1a-410a-a687-941bc2033d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2484248a-cf1a-410a-a687-941bc2033d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3898d05b-f323-42c9-8d1a-13a5f875858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3898d05b-f323-42c9-8d1a-13a5f875858c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f77996-b30d-4f14-8492-1f56914a20d9', 'volume_name': 'volume-b6f77996-b30d-4f14-8492-1f56914a20d9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ea809a-fe31-45df-ab78-fdc92db50f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ea809a-fe31-45df-ab78-fdc92db50f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93713df6-8972-474f-8500-904ba2486b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume b6f77996-b30d-4f14-8492-1f56914a20d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f77996-b30d-4f14-8492-1f56914a20d9', 'volume_size': 1} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ce821b-90d5-453c-816a-1b6b6846b7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66229d10278481bb41454b2ddf6f370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:16Z,use_quota=True,user_id='f110a5eed10c4f4dae61f350972d7bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fc73e03-25d3-4049-a629-3dc8e124ab8d),volume_type_id=3fc73e03-25d3-4049-a629-3dc8e124ab8d)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81424ec1-0a73-4950-a835-f95a179af078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81424ec1-0a73-4950-a835-f95a179af078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24c396b-4c76-42dd-90af-8930fa615622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (0336d599-b8e1-4024-b8ca-b8e402f8c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970bafd4-2d96-4897-93c3-8cf736721b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970bafd4-2d96-4897-93c3-8cf736721b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1327810479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22571e2-bd7c-4924-b521-b2550e91f86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:16Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf1ac6e-098a-4bd6-9480-e4151a189a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf1ac6e-098a-4bd6-9480-e4151a189a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39ce385-a3d5-4b55-8121-7da3b4b624de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39ce385-a3d5-4b55-8121-7da3b4b624de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22571e2-bd7c-4924-b521-b2550e91f86c', 'volume_name': 'volume-d22571e2-bd7c-4924-b521-b2550e91f86c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786779a8-8d85-4d03-a997-5f979ee96847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786779a8-8d85-4d03-a997-5f979ee96847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b6981e-6dc6-4d2a-8fe4-78260ac60104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume d22571e2-bd7c-4924-b521-b2550e91f86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22571e2-bd7c-4924-b521-b2550e91f86c', 'volume_size': 1} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (fdc287ca-7b2b-4574-87cb-aad453607b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e7706b-fce1-42b0-95f5-8b54bfd9ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:16 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 Jul 11 19:06:16 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e7706b-fce1-42b0-95f5-8b54bfd9ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1095196073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c2948-d339-4a1a-a03f-b9834a6900ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:16Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423062ad-448c-47d5-bd71-e0a45d9f3f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423062ad-448c-47d5-bd71-e0a45d9f3f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ba1ba2-76f6-4eb9-8f5d-893ef518c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ba1ba2-76f6-4eb9-8f5d-893ef518c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901c2948-d339-4a1a-a03f-b9834a6900ac', 'volume_name': 'volume-901c2948-d339-4a1a-a03f-b9834a6900ac', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9979eb6f-e95f-4609-9417-3062559e39d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9979eb6f-e95f-4609-9417-3062559e39d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e110488d-5987-487e-bc47-004d163c4085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume 901c2948-d339-4a1a-a03f-b9834a6900ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901c2948-d339-4a1a-a03f-b9834a6900ac', 'volume_size': 1} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24c396b-4c76-42dd-90af-8930fa615622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd', 'volume_name': 'volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd', 'volume_size': 1, 'image_id': '28039361-61ba-41b2-b9dd-dc37166faee0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28039361-61ba-41b2-b9dd-dc37166faee0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0349078a789aa64866d744a6a82be351', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd66229d10278481bb41454b2ddf6f370', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3dc3d8fe8a84bf4de384850c52b5afc7a6b45e0dca02d25dd346c0923e19b0ac6115fa43c29523c4e6940833d380cda5a1da429e3e43a8281bce9b5457f0bf26', 'id': '28039361-61ba-41b2-b9dd-dc37166faee0', 'created_at': datetime.datetime(2026, 7, 11, 17, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28039361-61ba-41b2-b9dd-dc37166faee0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aacc767-204d-4406-955a-c287b85e6c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aacc767-204d-4406-955a-c287b85e6c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33124575-348d-44e7-8fef-054ae5c0a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Volume 80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd', 'volume_size': 1, 'image_id': '28039361-61ba-41b2-b9dd-dc37166faee0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28039361-61ba-41b2-b9dd-dc37166faee0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0349078a789aa64866d744a6a82be351', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd66229d10278481bb41454b2ddf6f370', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3dc3d8fe8a84bf4de384850c52b5afc7a6b45e0dca02d25dd346c0923e19b0ac6115fa43c29523c4e6940833d380cda5a1da429e3e43a8281bce9b5457f0bf26', 'id': '28039361-61ba-41b2-b9dd-dc37166faee0', 'created_at': datetime.datetime(2026, 7, 11, 17, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28039361-61ba-41b2-b9dd-dc37166faee0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Trying to clone 80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd from image 28039361-61ba-41b2-b9dd-dc37166faee0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/28039361-61ba-41b2-b9dd-dc37166faee0', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 19:06:16 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Image download 0.00 MB at 0.00 MB/s Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f247abfb-6ae4-48be-b5da-db16f150bb40]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:17 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD Jul 11 19:06:17 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:17 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530" returned: 0 in 0.665s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] <== create_volume: return (2407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.410s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.218s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-796438212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c968beae-e64a-445e-8c55-a35707fa9092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:12Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Creating volume c968beae-e64a-445e-8c55-a35707fa9092 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:17 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1587fc-2cb6-4d59-8a9e-f9c36d7e3eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873a973d-b64d-4091-bbf5-b259c1506530', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:17 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 1073741824 Jul 11 19:06:17 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9dfaab9-8a4f-4ac9-bbe8-00240118e419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Volume volume-873a973d-b64d-4091-bbf5-b259c1506530 (873a973d-b64d-4091-bbf5-b259c1506530): created successfully Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9dfaab9-8a4f-4ac9-bbe8-00240118e419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (29b375bd-0bb7-41e1-a9c4-1c9987799633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-07e014b7-aab8-4bf3-860b-bc94802d714e tempest-CreateVolumesFromImageTest-1939189336 None] Created volume successfully. Jul 11 19:06:17 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:17 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD Jul 11 19:06:17 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:18 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 1073741824" returned: 0 in 0.852s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:18 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 Jul 11 19:06:18 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:18 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD" returned: 1 in 0.733s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Temporary image 28039361-61ba-41b2-b9dd-dc37166faee0 is fetched for user f110a5eed10c4f4dae61f350972d7bfb. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c54a3e3-862a-43f9-974e-20d9348c12b6]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:18 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD Jul 11 19:06:18 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:18 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092" returned: 0 in 0.677s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.425s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306479932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577468d9-18f9-4921-9d61-465a7c814e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:12Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Creating volume 577468d9-18f9-4921-9d61-465a7c814e9b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:18 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd0c1a9-151e-43ef-a2e4-187c535b743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c968beae-e64a-445e-8c55-a35707fa9092', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:18 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b 1073741824 Jul 11 19:06:18 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20f57d4-941d-4942-8de6-a8d3b2f3f7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Volume volume-c968beae-e64a-445e-8c55-a35707fa9092 (c968beae-e64a-445e-8c55-a35707fa9092): created successfully Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20f57d4-941d-4942-8de6-a8d3b2f3f7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (f4678a52-f3b2-4990-a5f3-b2a39d2b4879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8a0b1af3-3379-48dc-ab6e-50f00dce73ad tempest-CreateVolumesFromImageTest-1939189336 None] Created volume successfully. Jul 11 19:06:19 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD" returned: 0 in 0.713s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:19 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD Jul 11 19:06:19 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:19 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b 1073741824" returned: 0 in 0.828s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:19 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b Jul 11 19:06:19 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:19 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD" returned: 1 in 0.720s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:20 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b" returned: 0 in 0.662s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.548s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585424911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:13Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Creating volume bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:20 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd2c846-3fba-4ab1-887e-198e76c226ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577468d9-18f9-4921-9d61-465a7c814e9b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:20 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 1073741824 Jul 11 19:06:20 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41918de2-e42c-41ad-96cb-30888e04b78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Volume volume-577468d9-18f9-4921-9d61-465a7c814e9b (577468d9-18f9-4921-9d61-465a7c814e9b): created successfully Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41918de2-e42c-41ad-96cb-30888e04b78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (5acb7c19-8c07-4902-86c7-8a4826e82fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8e14b8f6-b1e6-4cba-840c-c014b243ea2e tempest-CreateVolumesFromImageTest-1939189336 None] Created volume successfully. Jul 11 19:06:21 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 1073741824" returned: 0 in 0.800s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:21 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 Jul 11 19:06:21 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:21 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8" returned: 0 in 0.649s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.653s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1743715382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635e3ff2-a0f6-430f-8fb9-d162e52bc6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda850e2c9a04f999da3f88bd1679855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:13Z,use_quota=True,user_id='c77a65f9b4cb48a7baec2ee2706038e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Creating volume 635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:21 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:21 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 1073741824 Jul 11 19:06:21 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14fcb13-79cd-42d1-9560-b89a0079008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3b7a88-c5b9-43e9-a4a4-621bf143ae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Volume volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 (bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8): created successfully Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3b7a88-c5b9-43e9-a4a4-621bf143ae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (4e6dcfa0-241a-4ee6-8266-8935d161c341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-da8564a7-1bcc-4bf1-b2a5-a360f639a47a tempest-CreateVolumesFromImageTest-1939189336 None] Created volume successfully. Jul 11 19:06:22 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 1073741824" returned: 0 in 0.833s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:22 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 Jul 11 19:06:22 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:23 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.890s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072256912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b6383b-3181-4f27-a717-a5f8bc33a5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:14Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Creating volume c0b6383b-3181-4f27-a717-a5f8bc33a5db {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:23 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef34ddc-600a-4bd0-915a-16d3c2cf858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:23 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db 1073741824 Jul 11 19:06:23 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4588d6b9-5b36-4a92-aa72-9db8801e443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Volume volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 (635e3ff2-a0f6-430f-8fb9-d162e52bc6a7): created successfully Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4588d6b9-5b36-4a92-aa72-9db8801e443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Flow 'volume_create_manager' (7af4ea6a-9894-41d4-84f2-99ab199e0583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-526d7c16-251f-4d17-b9b4-08ad7f9c874a tempest-CreateVolumesFromImageTest-1939189336 None] Created volume successfully. Jul 11 19:06:24 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db 1073741824" returned: 0 in 0.804s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:24 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db Jul 11 19:06:24 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-quobyte-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe21f342-9f5c-4168-994f-dd7bdb92a9dd]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:24 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 Jul 11 19:06:24 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:24 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db" returned: 0 in 0.701s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.860s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1968577077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4b6a25-e741-4ff9-a3e1-38b32d63608e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:15Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Creating volume ba4b6a25-e741-4ff9-a3e1-38b32d63608e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:24 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:25 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e 1073741824 Jul 11 19:06:25 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f73907b-cf86-4ea0-aa61-2b34e3ef5336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28756f5f-a904-4f47-9e0c-bf4abd338fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db (c0b6383b-3181-4f27-a717-a5f8bc33a5db): created successfully Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28756f5f-a904-4f47-9e0c-bf4abd338fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (2032e02e-d62e-4130-b3b3-618aad87e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f1f36a5e-259e-425d-ad97-a68cc6737186 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created volume successfully. Jul 11 19:06:25 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7" returned: 0 in 0.835s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:25 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7 Jul 11 19:06:25 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:25 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e 1073741824" returned: 0 in 0.926s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:25 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7" returned: 0 in 0.717s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7" released by "delete_volume" :: held 1.595s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:25 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e Jul 11 19:06:25 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Created reservations ['fde51765-1c18-485d-9695-4c354378ac48', '378cb464-be8d-4949-832d-f567ee34c0e3', 'ed349092-4cd9-471c-9b49-5acef1456238', '818aa871-857a-405f-9c76-70322f4123cd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:26 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:26 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:26 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-quobyte-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e" returned: 0 in 0.678s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.315s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54ca2a0-89ef-4999-8ff5-ab3f9c329896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b1c238-9f49-4f89-9511-d4d4b4f1f85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[76739939-1184-4cac-80ce-dfedf99e86ed]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Creating offline snapshot 8a0f181c-a52d-4d4c-9d00-5cf534b97086 of volume d3510683-9eac-4ece-979c-c73bb1aeb8f0 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f654b06-a7c2-49ee-a29c-4e18653cfefb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e (ba4b6a25-e741-4ff9-a3e1-38b32d63608e): created successfully Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b1c238-9f49-4f89-9511-d4d4b4f1f85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (e69b98eb-0469-449e-ad61-80cc6ca75606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c4a9f5d6-8d3d-4855-a172-3238c6911407 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created volume successfully. Jul 11 19:06:26 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 Jul 11 19:06:26 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:26 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 Jul 11 19:06:26 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:26 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.783s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Deleted volume successfully. Jul 11 19:06:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea9b8593-76fc-4d6b-890a-e648f7efb286 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-635e3ff2-a0f6-430f-8fb9-d162e52bc6a7-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:27 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8" returned: 0 in 0.839s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:27 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0" returned: 0 in 0.835s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:27 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8 Jul 11 19:06:27 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:27 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 1G Jul 11 19:06:27 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:28 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8" returned: 0 in 0.684s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8" released by "delete_volume" :: held 1.577s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Created reservations ['0f19c915-5bb9-44ac-8a95-5ae72bc67d6e', 'e48cbdab-966c-4270-b947-f94e0e2d1888', 'ac592b74-38d3-46b7-874b-57fb1cf36036', '6bc24eb4-8850-4f00-9a51-343e9a842b9a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:28 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 1G" returned: 0 in 0.824s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:28 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:28 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:28 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 Jul 11 19:06:28 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-577468d9-18f9-4921-9d61-465a7c814e9b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-577468d9-18f9-4921-9d61-465a7c814e9b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-quobyte-577468d9-18f9-4921-9d61-465a7c814e9b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-577468d9-18f9-4921-9d61-465a7c814e9b" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ac85a2-755b-43a6-9ba0-a0d0e2f799c5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:29 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b Jul 11 19:06:29 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:29 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.725s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Deleted volume successfully. Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5f4365a-0348-4a0d-83a0-b4151d3d677e tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-bb57dde6-b5cb-4c00-8bf3-ad8e0aac7ac8-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:29 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086" returned: 0 in 0.768s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:29 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 is being set with open permissions: ugo+rw Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:29 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 Jul 11 19:06:29 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:29 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b" returned: 0 in 0.808s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:29 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b Jul 11 19:06:29 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:29 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086" returned: 0 in 0.664s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:29 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.info Jul 11 19:06:29 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:30 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-577468d9-18f9-4921-9d61-465a7c814e9b" returned: 0 in 0.701s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-577468d9-18f9-4921-9d61-465a7c814e9b" released by "delete_volume" :: held 1.584s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Created reservations ['3892d32a-fdd7-474b-8e5c-c52a430a64af', '64df0146-2cb0-4f35-86ce-0296b531cf6a', '1b4ce9ee-3877-4b37-9ee5-89e91c3bd251', 'f5081e5a-bdb6-416e-9f14-25aaf7c58ea1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:30 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.info" returned: 0 in 0.707s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:30 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.info is being set with open permissions: ugo+rw Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:30 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.info Jul 11 19:06:30 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:30 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:30 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-c968beae-e64a-445e-8c55-a35707fa9092-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-c968beae-e64a-445e-8c55-a35707fa9092-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-quobyte-c968beae-e64a-445e-8c55-a35707fa9092" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-c968beae-e64a-445e-8c55-a35707fa9092" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4070b3c9-fe17-455f-ac7c-f4abc712efa3]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:31 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.711s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Deleted volume successfully. Jul 11 19:06:31 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f33b5248-ad4c-4652-8689-8b9084820184 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-577468d9-18f9-4921-9d61-465a7c814e9b-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.info" returned: 0 in 0.782s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.713s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.965s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-947629268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f77996-b30d-4f14-8492-1f56914a20d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:16Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Creating volume b6f77996-b30d-4f14-8492-1f56914a20d9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:31 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 Jul 11 19:06:31 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:31 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 1073741824 Jul 11 19:06:31 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e2a56951-90c6-4083-a254-6e3737d52dfd tempest-CreateVolumesFromSnapshotTest-75002915 None] Create snapshot completed successfully Jul 11 19:06:32 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:32 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092 Jul 11 19:06:32 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:32 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 1073741824" returned: 0 in 0.910s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:32 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 Jul 11 19:06:32 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (837ddbc5-e610-47b0-9900-23ab0e5e7201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756a43cf-989a-4b22-a07d-c6f2b0301440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756a43cf-989a-4b22-a07d-c6f2b0301440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1737068390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99512f08-d2cd-4c08-b856-8fb59a16d80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:33Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924f2d0d-05ef-4b0d-a159-2160835b091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924f2d0d-05ef-4b0d-a159-2160835b091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:32 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313d8f9d-e70c-4eaa-b4aa-647a5afaae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313d8f9d-e70c-4eaa-b4aa-647a5afaae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99512f08-d2cd-4c08-b856-8fb59a16d80c', 'volume_name': 'volume-99512f08-d2cd-4c08-b856-8fb59a16d80c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb58f18-daa6-4500-8df2-0152f83b13e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb58f18-daa6-4500-8df2-0152f83b13e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acdd7d36-4d6f-4e10-b361-36aef0e68377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume 99512f08-d2cd-4c08-b856-8fb59a16d80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99512f08-d2cd-4c08-b856-8fb59a16d80c', 'volume_size': 1} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c968beae-e64a-445e-8c55-a35707fa9092" returned: 0 in 0.743s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-c968beae-e64a-445e-8c55-a35707fa9092" released by "delete_volume" :: held 1.578s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Created reservations ['d3ccce5a-58e7-4434-9866-d2010b6f0a5a', '5ad4e0ba-d8e8-4266-86c4-ee7cfe21cedd', '96970c78-e2e4-47a3-84e6-645085e6e620', '90d1961f-fc8e-4e14-b1f4-b71aa1a99323'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:32 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:32 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:33 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (2c6ffb15-0087-45e5-8fd1-9af2fcdf011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d314f670-f985-46b2-a887-19226f034170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9" returned: 0 in 0.782s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.601s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1327810479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22571e2-bd7c-4924-b521-b2550e91f86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:16Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Creating volume d22571e2-bd7c-4924-b521-b2550e91f86c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d314f670-f985-46b2-a887-19226f034170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1634093321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb50811d-50e0-44df-8c6f-4abec78bf42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:33Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7080aca-7959-4f2e-bc6c-85baaff0f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7080aca-7959-4f2e-bc6c-85baaff0f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c 1073741824 Jul 11 19:06:33 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b452ce-4c2d-4e5c-a74e-bfc941ebf27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b452ce-4c2d-4e5c-a74e-bfc941ebf27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb50811d-50e0-44df-8c6f-4abec78bf42c', 'volume_name': 'volume-eb50811d-50e0-44df-8c6f-4abec78bf42c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eae2fd5-7c13-4bdf-8125-88f80a64e1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eae2fd5-7c13-4bdf-8125-88f80a64e1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25ad9fb-ac43-4570-b139-b963f8902c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume eb50811d-50e0-44df-8c6f-4abec78bf42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb50811d-50e0-44df-8c6f-4abec78bf42c', 'volume_size': 1} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93713df6-8972-474f-8500-904ba2486b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f77996-b30d-4f14-8492-1f56914a20d9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617b9f4-7034-43d4-abb4-07d8a47c8d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume volume-b6f77996-b30d-4f14-8492-1f56914a20d9 (b6f77996-b30d-4f14-8492-1f56914a20d9): created successfully Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617b9f4-7034-43d4-abb4-07d8a47c8d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (49a3c1fa-d0db-44f7-b274-893e545fffae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d6f0def5-b654-4e65-9bb1-1dd31a3d5b64 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created volume successfully. Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-873a973d-b64d-4091-bbf5-b259c1506530-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-873a973d-b64d-4091-bbf5-b259c1506530-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "cinder-quobyte-873a973d-b64d-4091-bbf5-b259c1506530" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-873a973d-b64d-4091-bbf5-b259c1506530" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[095ac494-e6c9-45b2-bb5f-5dad63690a65]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (efb039a7-5cad-4c3b-8795-0f55eedc6e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293a631-1c68-4b15-bdef-b6ac1a1d05f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 Jul 11 19:06:33 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293a631-1c68-4b15-bdef-b6ac1a1d05f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215454940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ee56fd-28e0-4e3d-be47-1f760c88ad7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:34Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a580a7e5-8851-4cf3-a333-6eb74bd0462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a580a7e5-8851-4cf3-a333-6eb74bd0462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a4e965-b292-4972-806d-8c8e380d76c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a4e965-b292-4972-806d-8c8e380d76c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ee56fd-28e0-4e3d-be47-1f760c88ad7e', 'volume_name': 'volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5398dd-49ea-43b0-9fe3-8b37dd1b0d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5398dd-49ea-43b0-9fe3-8b37dd1b0d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b53a4b1-dded-4a80-a1d7-24b2a98ec469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume 84ee56fd-28e0-4e3d-be47-1f760c88ad7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e', 'volume_size': 1} Jul 11 19:06:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:34 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.112s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Deleted volume successfully. Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (24cceaf1-d90f-40c3-abba-2b486ca0d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276db06c-667d-4b71-a055-e2a78ed3c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c063b9b5-888e-4e89-83a8-06aeefaeb4e1 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-c968beae-e64a-445e-8c55-a35707fa9092-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276db06c-667d-4b71-a055-e2a78ed3c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-59548724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7788e3-e961-4166-a441-3847e7bcf53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:34Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed76185-cbee-4c39-88bc-f46a67ad6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed76185-cbee-4c39-88bc-f46a67ad6eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a3a20c-100f-48ed-8f29-c8495b0afc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a3a20c-100f-48ed-8f29-c8495b0afc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7788e3-e961-4166-a441-3847e7bcf53a', 'volume_name': 'volume-8c7788e3-e961-4166-a441-3847e7bcf53a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5b7977-b6ba-4d5a-8e12-6f2ab625109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5b7977-b6ba-4d5a-8e12-6f2ab625109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a60743-846b-4df5-9723-898192c64f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume 8c7788e3-e961-4166-a441-3847e7bcf53a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7788e3-e961-4166-a441-3847e7bcf53a', 'volume_size': 1} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:34 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c 1073741824" returned: 0 in 1.256s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:34 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c Jul 11 19:06:34 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (5241ba92-9f43-4eaa-923b-d933fb5111a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c670f1-eef4-40c1-abf3-d74da37cbb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c670f1-eef4-40c1-abf3-d74da37cbb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507773889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e8e4d9-c647-424a-a596-789db37f10ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:34Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941fa158-38bb-42d3-a443-689cd3fa71c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941fa158-38bb-42d3-a443-689cd3fa71c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ed0cbc-d7f7-44d5-8ee8-7a5911ec674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ed0cbc-d7f7-44d5-8ee8-7a5911ec674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e8e4d9-c647-424a-a596-789db37f10ad', 'volume_name': 'volume-e1e8e4d9-c647-424a-a596-789db37f10ad', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ac37c2-a635-49fc-bf85-b91d1083f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ac37c2-a635-49fc-bf85-b91d1083f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b26534-10f4-46aa-8255-78538678ab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume e1e8e4d9-c647-424a-a596-789db37f10ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e8e4d9-c647-424a-a596-789db37f10ad', 'volume_size': 1} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:34 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530" returned: 0 in 1.064s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:34 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530 Jul 11 19:06:34 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:35 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.473s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1095196073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c2948-d339-4a1a-a03f-b9834a6900ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2cfd65fde449e28e1dfaae35000f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:16Z,use_quota=True,user_id='d7e5393e923b4d98b159a64a452b899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Creating volume 901c2948-d339-4a1a-a03f-b9834a6900ac {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:35 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:35 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac 1073741824 Jul 11 19:06:35 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b6981e-6dc6-4d2a-8fe4-78260ac60104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22571e2-bd7c-4924-b521-b2550e91f86c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7288857c-93cb-4b03-996f-bd5883e7dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume volume-d22571e2-bd7c-4924-b521-b2550e91f86c (d22571e2-bd7c-4924-b521-b2550e91f86c): created successfully Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7288857c-93cb-4b03-996f-bd5883e7dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (0336d599-b8e1-4024-b8ca-b8e402f8c215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1e36277b-ffea-441c-bd4a-dba8c792336d tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created volume successfully. Jul 11 19:06:35 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-873a973d-b64d-4091-bbf5-b259c1506530" returned: 0 in 0.659s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-quobyte-873a973d-b64d-4091-bbf5-b259c1506530" released by "delete_volume" :: held 1.792s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Created reservations ['0b851d5a-5159-45eb-a298-c399a3a53caf', 'dd21c96e-373e-4c90-ae7a-2287b8e09460', 'fbf62f84-f207-463a-a768-842dd6a693a9', 'bcf202c2-2c3a-423f-8ffb-4fbae98df052'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:35 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:35 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:36 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac 1073741824" returned: 0 in 0.968s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:36 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac Jul 11 19:06:36 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:36 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.727s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Deleted volume successfully. Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6819eb0a-8057-4a07-9d42-18ca058c9af9 tempest-CreateVolumesFromImageTest-1939189336 None] Lock "cinder-873a973d-b64d-4091-bbf5-b259c1506530-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:36 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.926s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66229d10278481bb41454b2ddf6f370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:16Z,use_quota=True,user_id='f110a5eed10c4f4dae61f350972d7bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fc73e03-25d3-4049-a629-3dc8e124ab8d),volume_type_id=3fc73e03-25d3-4049-a629-3dc8e124ab8d)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Creating volume 80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:36 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:36 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd 1073741824 Jul 11 19:06:36 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e110488d-5987-487e-bc47-004d163c4085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901c2948-d339-4a1a-a03f-b9834a6900ac', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03079cce-a9f8-4868-b442-ec79142fe64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:36 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Volume volume-901c2948-d339-4a1a-a03f-b9834a6900ac (901c2948-d339-4a1a-a03f-b9834a6900ac): created successfully Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03079cce-a9f8-4868-b442-ec79142fe64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Flow 'volume_create_manager' (fdc287ca-7b2b-4574-87cb-aad453607b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-18cfc481-b9c7-44ea-8fb7-fe02aefb76f9 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created volume successfully. Jul 11 19:06:37 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd 1073741824" returned: 0 in 0.970s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:37 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd Jul 11 19:06:37 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-901c2948-d339-4a1a-a03f-b9834a6900ac-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-901c2948-d339-4a1a-a03f-b9834a6900ac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-quobyte-901c2948-d339-4a1a-a03f-b9834a6900ac" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-901c2948-d339-4a1a-a03f-b9834a6900ac" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26f3900-ce62-43cf-8d27-9a34e4e01b49]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:38 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac Jul 11 19:06:38 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:38 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.737s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1737068390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99512f08-d2cd-4c08-b856-8fb59a16d80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:33Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Creating volume 99512f08-d2cd-4c08-b856-8fb59a16d80c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:38 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:38 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c 1073741824 Jul 11 19:06:38 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Attempting download of 28039361-61ba-41b2-b9dd-dc37166faee0 ((None, [{'url': 'file:///opt/stack/data/glance/images/28039361-61ba-41b2-b9dd-dc37166faee0', 'metadata': {}}])) to volume 80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c4f1c6-3fd0-4927-acb2-4df4c28a9be8]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28039361-61ba-41b2-b9dd-dc37166faee0_1v2k3dwx {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:38 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28039361-61ba-41b2-b9dd-dc37166faee0_1v2k3dwx Jul 11 19:06:38 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:39 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac" returned: 0 in 0.911s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:39 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac Jul 11 19:06:39 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:39 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28039361-61ba-41b2-b9dd-dc37166faee0_1v2k3dwx" returned: 0 in 0.863s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28039361-61ba-41b2-b9dd-dc37166faee0_1v2k3dwx {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:39 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28039361-61ba-41b2-b9dd-dc37166faee0_1v2k3dwx Jul 11 19:06:39 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:39 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c 1073741824" returned: 0 in 1.105s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:39 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c Jul 11 19:06:39 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:39 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-901c2948-d339-4a1a-a03f-b9834a6900ac" returned: 0 in 0.799s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-901c2948-d339-4a1a-a03f-b9834a6900ac" released by "delete_volume" :: held 1.777s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created reservations ['18b08b1d-1317-4f9f-9e5e-b63d0b4bd5a9', 'bed6c2ee-da90-4093-83b0-0a674b7a69b8', '7bb5a5df-37c2-4141-8b69-d1af53695c32', '9a156963-8f2c-4d78-a07e-592908df98f0'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:40 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:40 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-d22571e2-bd7c-4924-b521-b2550e91f86c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-d22571e2-bd7c-4924-b521-b2550e91f86c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:40 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:40 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28039361-61ba-41b2-b9dd-dc37166faee0_1v2k3dwx" returned: 1 in 0.968s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28039361-61ba-41b2-b9dd-dc37166faee0_1v2k3dwx' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c" returned: 0 in 0.814s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cbeeeb-d4da-4128-8130-6c2933e13fb8]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.278s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1634093321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb50811d-50e0-44df-8c6f-4abec78bf42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:33Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Creating volume eb50811d-50e0-44df-8c6f-4abec78bf42c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:40 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c 1073741824 Jul 11 19:06:40 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acdd7d36-4d6f-4e10-b361-36aef0e68377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99512f08-d2cd-4c08-b856-8fb59a16d80c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34db193-b6dd-45e4-b538-5475adc888cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-quobyte-d22571e2-bd7c-4924-b521-b2550e91f86c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume volume-99512f08-d2cd-4c08-b856-8fb59a16d80c (99512f08-d2cd-4c08-b856-8fb59a16d80c): created successfully Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34db193-b6dd-45e4-b538-5475adc888cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (837ddbc5-e610-47b0-9900-23ab0e5e7201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:40 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD Jul 11 19:06:40 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-d22571e2-bd7c-4924-b521-b2550e91f86c" acquired by "delete_volume" :: waited 0.057s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dd73a2da-0036-48fb-b921-a97d1fbd1822 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created volume successfully. Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa9407-4782-47b4-957b-c2a5fa3e2f53]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:40 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c Jul 11 19:06:40 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:41 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.146s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Deleted volume successfully. Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35000dca-5ce5-4abc-8545-55b22db294bf tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-901c2948-d339-4a1a-a03f-b9834a6900ac-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:41 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD" returned: 0 in 0.995s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:41 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD Jul 11 19:06:41 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:41 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c" returned: 0 in 0.993s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:41 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c 1073741824" returned: 0 in 1.228s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:41 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c Jul 11 19:06:41 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:41 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c Jul 11 19:06:41 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Flow 'volume_create_manager' (1ac28d60-097f-4f87-b225-6638ee20fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d092ecea-a2d0-4940-af5b-c525ddc04503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d092ecea-a2d0-4940-af5b-c525ddc04503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60b8e7e-6174-43d9-84d0-8ff239c08525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddad01ee7cb3478e94388ded73efdbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:42Z,use_quota=True,user_id='52fe5ac5fa1b44e88c49d44e58e0a1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ee4f31-260c-4a4a-8657-3b78fa80b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ee4f31-260c-4a4a-8657-3b78fa80b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d25c67-1788-4c44-9c70-e5d49fd9d9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d25c67-1788-4c44-9c70-e5d49fd9d9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c60b8e7e-6174-43d9-84d0-8ff239c08525', 'volume_name': 'volume-c60b8e7e-6174-43d9-84d0-8ff239c08525', 'volume_size': 1, 'image_id': '003fd243-5df0-4a5c-8516-ee64ddc926cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/003fd243-5df0-4a5c-8516-ee64ddc926cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e18b02bb19db290b1a1de844e6c83eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddad01ee7cb3478e94388ded73efdbc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c41e1186dc2042cfe4e19662dd1fece5563a63d9c2dc0fa4046fc4dbfb313b8db11567b4f66999e0d488e256cff6b17d17f36fa978e9176366de5d38bb0c565c', 'id': '003fd243-5df0-4a5c-8516-ee64ddc926cf', 'created_at': datetime.datetime(2026, 7, 11, 17, 6, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 6, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/003fd243-5df0-4a5c-8516-ee64ddc926cf/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9c72e3-93e6-4ca9-9959-a18ce2b6d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9c72e3-93e6-4ca9-9959-a18ce2b6d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f00034-a5d5-4187-932b-433e89bde299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:42 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Volume c60b8e7e-6174-43d9-84d0-8ff239c08525: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c60b8e7e-6174-43d9-84d0-8ff239c08525', 'volume_size': 1, 'image_id': '003fd243-5df0-4a5c-8516-ee64ddc926cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/003fd243-5df0-4a5c-8516-ee64ddc926cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e18b02bb19db290b1a1de844e6c83eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddad01ee7cb3478e94388ded73efdbc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c41e1186dc2042cfe4e19662dd1fece5563a63d9c2dc0fa4046fc4dbfb313b8db11567b4f66999e0d488e256cff6b17d17f36fa978e9176366de5d38bb0c565c', 'id': '003fd243-5df0-4a5c-8516-ee64ddc926cf', 'created_at': datetime.datetime(2026, 7, 11, 17, 6, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 6, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/003fd243-5df0-4a5c-8516-ee64ddc926cf/file', 'properties': {}}, 'image_service': } Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Trying to clone c60b8e7e-6174-43d9-84d0-8ff239c08525 from image 003fd243-5df0-4a5c-8516-ee64ddc926cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/003fd243-5df0-4a5c-8516-ee64ddc926cf', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 19:06:42 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD" returned: 1 in 0.986s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] 28039361-61ba-41b2-b9dd-dc37166faee0 was raw, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 19:06:42 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Image download 0.00 MB at 0.00 MB/s Jul 11 19:06:42 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd Jul 11 19:06:42 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:42 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d22571e2-bd7c-4924-b521-b2550e91f86c" returned: 0 in 0.840s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:42 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-d22571e2-bd7c-4924-b521-b2550e91f86c" released by "delete_volume" :: held 1.910s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c" returned: 0 in 0.806s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.721s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215454940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ee56fd-28e0-4e3d-be47-1f760c88ad7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:34Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Creating volume 84ee56fd-28e0-4e3d-be47-1f760c88ad7e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:42 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70d39c9-f955-408e-9acd-d5e6ca8b53cc]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:42 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e 1073741824 Jul 11 19:06:42 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25ad9fb-ac43-4570-b139-b963f8902c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb50811d-50e0-44df-8c6f-4abec78bf42c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242c00b3-9418-46cc-aea1-6abc705a3880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:42 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume volume-eb50811d-50e0-44df-8c6f-4abec78bf42c (eb50811d-50e0-44df-8c6f-4abec78bf42c): created successfully Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242c00b3-9418-46cc-aea1-6abc705a3880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (2c6ffb15-0087-45e5-8fd1-9af2fcdf011c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7c098f50-bdbd-4f5f-b79c-d04a6ea96bdc tempest-CreateVolumesFromSnapshotTest-75002915 None] Created volume successfully. Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created reservations ['3398de54-31e8-44cb-be16-dcec38ae951c', '8e193e40-8cc6-4818-96be-9a129f3be9d6', 'df5e5fc0-823e-45a3-81f4-1e125fa82e68', '8b54f3e8-9cc8-46b4-a9f8-174cfdd63adf'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:42 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD Jul 11 19:06:42 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:42 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:42 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:43 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" returned: 0 in 0.895s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_28039361-61ba-41b2-b9dd-dc37166faee0_p1eyt7s5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:06:43 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:43 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd 1G Jul 11 19:06:43 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:43 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD" returned: 0 in 0.887s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:43 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.814s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Deleted volume successfully. Jul 11 19:06:43 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD Jul 11 19:06:43 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:43 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12dc73de-4252-4985-8ded-252ec0e19764 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-d22571e2-bd7c-4924-b521-b2550e91f86c-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e 1073741824" returned: 0 in 1.052s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:43 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e Jul 11 19:06:43 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-b6f77996-b30d-4f14-8492-1f56914a20d9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-b6f77996-b30d-4f14-8492-1f56914a20d9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-quobyte-b6f77996-b30d-4f14-8492-1f56914a20d9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-b6f77996-b30d-4f14-8492-1f56914a20d9" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[997897cb-726b-4507-949c-a2fbce2e70db]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:44 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 Jul 11 19:06:44 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:44 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd 1G" returned: 0 in 0.794s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f4ea6a-b449-4d95-984f-31322107dbf6]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:44 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD" returned: 1 in 0.829s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Temporary image 003fd243-5df0-4a5c-8516-ee64ddc926cf is fetched for user 52fe5ac5fa1b44e88c49d44e58e0a1c6. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 19:06:44 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd Jul 11 19:06:44 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7582f88f-b643-4287-a8d5-449aff369202]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:44 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e" returned: 0 in 0.805s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.308s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-59548724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7788e3-e961-4166-a441-3847e7bcf53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:34Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Creating volume 8c7788e3-e961-4166-a441-3847e7bcf53a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:44 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b53a4b1-dded-4a80-a1d7-24b2a98ec469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400f9593-7942-4cf5-8ae1-8d1ea3dd2d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:44 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a 1073741824 Jul 11 19:06:44 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:44 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e (84ee56fd-28e0-4e3d-be47-1f760c88ad7e): created successfully Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400f9593-7942-4cf5-8ae1-8d1ea3dd2d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (efb039a7-5cad-4c3b-8795-0f55eedc6e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-561a8e58-f736-4bd2-8c73-e52863714b46 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created volume successfully. Jul 11 19:06:44 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD Jul 11 19:06:44 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:44 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9" returned: 0 in 0.892s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:44 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9 Jul 11 19:06:44 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:45 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" returned: 0 in 0.999s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:45 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd Jul 11 19:06:45 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:45 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD" returned: 0 in 0.983s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:45 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a 1073741824" returned: 0 in 0.992s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:45 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD Jul 11 19:06:45 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:45 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:45 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a Jul 11 19:06:45 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b6f77996-b30d-4f14-8492-1f56914a20d9" returned: 0 in 0.771s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-b6f77996-b30d-4f14-8492-1f56914a20d9" released by "delete_volume" :: held 1.720s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created reservations ['6067b256-500a-4b29-aafa-426badd1db43', '497fef3f-30ce-46a0-acff-5e974a0b22c3', '04c2696f-160d-424b-8336-cbd8252f21b4', '2377478e-ef50-475b-8960-a556f5b5006a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:45 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:45 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-ba4b6a25-e741-4ff9-a3e1-38b32d63608e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-ba4b6a25-e741-4ff9-a3e1-38b32d63608e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-quobyte-ba4b6a25-e741-4ff9-a3e1-38b32d63608e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-ba4b6a25-e741-4ff9-a3e1-38b32d63608e" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f1d2e0-7273-41e8-86bc-ac938b186fd0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:46 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" returned: 1 in 1.030s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Downloaded image 28039361-61ba-41b2-b9dd-dc37166faee0 ((None, [{'url': 'file:///opt/stack/data/glance/images/28039361-61ba-41b2-b9dd-dc37166faee0', 'metadata': {}}])) to volume 80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Temporary image 28039361-61ba-41b2-b9dd-dc37166faee0 for user f110a5eed10c4f4dae61f350972d7bfb is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Marking volume 80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Copying metadata from image 28039361-61ba-41b2-b9dd-dc37166faee0 to 80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Creating volume glance metadata for volume 80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd backed by image 28039361-61ba-41b2-b9dd-dc37166faee0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '28039361-61ba-41b2-b9dd-dc37166faee0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0349078a789aa64866d744a6a82be351', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 19:06:46 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD" returned: 1 in 0.947s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33124575-348d-44e7-8fef-054ae5c0a52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd', 'volume_size': 1, 'image_id': '28039361-61ba-41b2-b9dd-dc37166faee0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28039361-61ba-41b2-b9dd-dc37166faee0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0349078a789aa64866d744a6a82be351', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd66229d10278481bb41454b2ddf6f370', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3dc3d8fe8a84bf4de384850c52b5afc7a6b45e0dca02d25dd346c0923e19b0ac6115fa43c29523c4e6940833d380cda5a1da429e3e43a8281bce9b5457f0bf26', 'id': '28039361-61ba-41b2-b9dd-dc37166faee0', 'created_at': datetime.datetime(2026, 7, 11, 17, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28039361-61ba-41b2-b9dd-dc37166faee0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba39a975-f98b-4c29-bac6-b1267085034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:46 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a" returned: 0 in 0.878s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.839s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507773889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e8e4d9-c647-424a-a596-789db37f10ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fe98d0f6194c8aa4e94634b48f5a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:34Z,use_quota=True,user_id='295187e21c85412c992ced60776f9a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Creating volume e1e8e4d9-c647-424a-a596-789db37f10ad {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:46 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:46 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e Jul 11 19:06:46 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Volume volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd (80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd): created successfully Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba39a975-f98b-4c29-bac6-b1267085034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:46 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad 1073741824 Jul 11 19:06:46 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Flow 'volume_create_manager' (fefeb7ed-cd4c-4e7a-98c0-87341570d594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a60743-846b-4df5-9723-898192c64f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7788e3-e961-4166-a441-3847e7bcf53a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e14188b-5ee6-42de-855e-bb89f71cc09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-859f0755-f05f-4aa5-b7bb-c00574ba5c77 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Created volume successfully. Jul 11 19:06:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume volume-8c7788e3-e961-4166-a441-3847e7bcf53a (8c7788e3-e961-4166-a441-3847e7bcf53a): created successfully Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e14188b-5ee6-42de-855e-bb89f71cc09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (24cceaf1-d90f-40c3-abba-2b486ca0d050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-040cadb8-93ad-438b-9aca-5798acb578e6 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created volume successfully. Jul 11 19:06:46 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.852s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Deleted volume successfully. Jul 11 19:06:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e9559da9-ab6a-4138-8ee5-8d9a09a812f7 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-b6f77996-b30d-4f14-8492-1f56914a20d9-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:47 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e" returned: 0 in 0.930s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:47 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e Jul 11 19:06:47 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:47 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad 1073741824" returned: 0 in 0.913s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:47 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad Jul 11 19:06:47 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Acquiring lock "cinder-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "cinder-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Acquiring lock "cinder-quobyte-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "cinder-quobyte-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8030fd41-9202-4a25-867f-3fb98253a1c5]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:47 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd Jul 11 19:06:47 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:47 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ba4b6a25-e741-4ff9-a3e1-38b32d63608e" returned: 0 in 0.711s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-ba4b6a25-e741-4ff9-a3e1-38b32d63608e" released by "delete_volume" :: held 1.694s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created reservations ['1fd3b2b8-6f14-4562-b0f0-6c1d97303973', '2002e112-6468-4c20-b07f-9336d21d9bed', '44414850-0bba-4bcc-b44f-92f8c760dfb1', '6258d0aa-4c0d-4f0f-9496-8f0fc322afe6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:48 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:48 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:48 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad" returned: 0 in 0.691s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60b8e7e-6174-43d9-84d0-8ff239c08525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddad01ee7cb3478e94388ded73efdbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:06:42Z,use_quota=True,user_id='52fe5ac5fa1b44e88c49d44e58e0a1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Creating volume c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:06:48 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b26534-10f4-46aa-8255-78538678ab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e8e4d9-c647-424a-a596-789db37f10ad', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:48 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 1073741824 Jul 11 19:06:48 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea79478-cd42-4864-9df2-09e1bd1a0dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Volume volume-e1e8e4d9-c647-424a-a596-789db37f10ad (e1e8e4d9-c647-424a-a596-789db37f10ad): created successfully Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea79478-cd42-4864-9df2-09e1bd1a0dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Flow 'volume_create_manager' (5241ba92-9f43-4eaa-923b-d933fb5111a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9b07cf59-5d15-402c-8904-1c5069fcd703 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created volume successfully. Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-c0b6383b-3181-4f27-a717-a5f8bc33a5db-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-c0b6383b-3181-4f27-a717-a5f8bc33a5db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-quobyte-c0b6383b-3181-4f27-a717-a5f8bc33a5db" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-c0b6383b-3181-4f27-a717-a5f8bc33a5db" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf413032-b8b9-4a6c-bf3d-a90480cff87d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:48 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" returned: 0 in 0.866s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:48 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db Jul 11 19:06:48 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:48 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd Jul 11 19:06:48 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:48 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.842s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:48 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Deleted volume successfully. Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dcc15dc5-3c96-4076-96bf-575636ca1563 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-ba4b6a25-e741-4ff9-a3e1-38b32d63608e-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-e1e8e4d9-c647-424a-a596-789db37f10ad-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-e1e8e4d9-c647-424a-a596-789db37f10ad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-quobyte-e1e8e4d9-c647-424a-a596-789db37f10ad" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-e1e8e4d9-c647-424a-a596-789db37f10ad" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1499a7ad-6c31-4556-8b47-42fa6f24aa9e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:49 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 1073741824" returned: 0 in 1.082s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:49 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 Jul 11 19:06:49 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:49 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad Jul 11 19:06:49 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:49 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db" returned: 0 in 0.988s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:49 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:49 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db Jul 11 19:06:49 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" returned: 1 in 0.977s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:49 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd Jul 11 19:06:49 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:49 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525" returned: 0 in 0.754s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Attempting download of 003fd243-5df0-4a5c-8516-ee64ddc926cf ((None, [{'url': 'file:///opt/stack/data/glance/images/003fd243-5df0-4a5c-8516-ee64ddc926cf', 'metadata': {}}])) to volume c60b8e7e-6174-43d9-84d0-8ff239c08525. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 19:06:50 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad" returned: 0 in 0.925s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[579cbcd5-7507-44de-92ee-0c1ca3102b6a]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_003fd243-5df0-4a5c-8516-ee64ddc926cf_retnbg0g {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:50 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad Jul 11 19:06:50 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:50 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_003fd243-5df0-4a5c-8516-ee64ddc926cf_retnbg0g Jul 11 19:06:50 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:50 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" returned: 0 in 0.712s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:50 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c0b6383b-3181-4f27-a717-a5f8bc33a5db" returned: 0 in 0.761s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "cinder-quobyte-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd" released by "delete_volume" :: held 2.629s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-c0b6383b-3181-4f27-a717-a5f8bc33a5db" released by "delete_volume" :: held 1.807s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created reservations ['f6e59459-4d0d-4ef7-9757-22448c63f018', 'ae31466a-bfd9-4a80-b786-ac7e2f4ec191', '27c2ef47-e25a-44c1-9b1a-7916bb138efb', 'f425b05d-19fc-4c47-9f53-d075058dd8fd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Created reservations ['12ec8897-59bc-40b6-81f8-4c40b688f556', '202b08e3-a7f3-41c6-8cdd-c684721b14bc', '7e49dd2d-d76e-4ba5-b588-f1832b14b30d', 'd6a1b22d-17d3-401f-9f19-7ce59d8c8ef8'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:50 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:50 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:50 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:50 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-0d1fe25b-7e08-464c-926d-b5fb834ffccf-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-0d1fe25b-7e08-464c-926d-b5fb834ffccf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "cinder-quobyte-0d1fe25b-7e08-464c-926d-b5fb834ffccf" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-0d1fe25b-7e08-464c-926d-b5fb834ffccf" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bf7266-c1a0-414f-8711-c19c4f5cae81]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:50 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_003fd243-5df0-4a5c-8516-ee64ddc926cf_retnbg0g" returned: 0 in 0.889s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_003fd243-5df0-4a5c-8516-ee64ddc926cf_retnbg0g {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:51 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-e1e8e4d9-c647-424a-a596-789db37f10ad" returned: 0 in 0.963s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-e1e8e4d9-c647-424a-a596-789db37f10ad" released by "delete_volume" :: held 1.948s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:51 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf Jul 11 19:06:51 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created reservations ['7f350f67-5913-4fca-a201-6c9e8ffdffd0', '11e38dc5-ed7b-4b81-938e-bf3164333242', 'c2681cc1-7bb9-41c3-b604-26325cefd7b8', '68f4b2e4-11c8-4b80-94ee-c6006e4ba79e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:51 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_003fd243-5df0-4a5c-8516-ee64ddc926cf_retnbg0g Jul 11 19:06:51 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-8c7788e3-e961-4166-a441-3847e7bcf53a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:51 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:51 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-8c7788e3-e961-4166-a441-3847e7bcf53a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-quobyte-8c7788e3-e961-4166-a441-3847e7bcf53a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-8c7788e3-e961-4166-a441-3847e7bcf53a" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f40dd-0663-4cc4-8e2b-2383684ced2d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:51 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.217s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Deleted volume successfully. Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f949258-3e5d-4c01-ad6b-0346e9fc6322 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-c0b6383b-3181-4f27-a717-a5f8bc33a5db-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:51 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Deleted volume successfully. Jul 11 19:06:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9144549d-a8bc-4bf8-8d3f-480d0d3a27c8 tempest-VolumeAndVolumeTypeFromImageTest-136826666 None] Lock "cinder-80fb7f69-c434-42a8-ad4e-8d7dfcc5d9fd-delete_volume" released by "delete_volume" :: held 4.296s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:51 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a Jul 11 19:06:51 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:52 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_003fd243-5df0-4a5c-8516-ee64ddc926cf_retnbg0g" returned: 1 in 1.307s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_003fd243-5df0-4a5c-8516-ee64ddc926cf_retnbg0g' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ee1d4f-fd5f-4e57-b7fe-ca0019451101]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:52 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf" returned: 0 in 1.501s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:52 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf Jul 11 19:06:52 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:52 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.075s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:52 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD Jul 11 19:06:52 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Deleted volume successfully. Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37518abb-7ad8-4e29-8165-209a5c55eba4 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-e1e8e4d9-c647-424a-a596-789db37f10ad-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:52 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a" returned: 0 in 1.071s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:52 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a Jul 11 19:06:52 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:53 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:53 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0d1fe25b-7e08-464c-926d-b5fb834ffccf" returned: 0 in 0.896s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-quobyte-0d1fe25b-7e08-464c-926d-b5fb834ffccf" released by "delete_volume" :: held 2.468s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:53 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD Jul 11 19:06:53 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Created reservations ['b5c3b558-da39-4703-95db-d8a19fcd3119', '1f42a6a5-2653-47b6-876a-bd976e5ca0aa', 'df72d873-a902-453f-80d8-4513e6a8717f', 'a13bb56b-c26d-4bd6-b85f-f986d0aac70d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:53 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:53 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:53 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8c7788e3-e961-4166-a441-3847e7bcf53a" returned: 0 in 0.826s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-8c7788e3-e961-4166-a441-3847e7bcf53a" released by "delete_volume" :: held 1.985s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created reservations ['18ff0675-355e-4845-b41b-50ac53aacb4c', 'c1ec661a-b677-4c19-921e-b1730a893b8b', '93990615-614c-49fc-ac08-238508f4ff40', 'cf00bbb8-1f01-41c5-b51f-f52bda718628'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:53 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:53 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:54 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD" returned: 1 in 0.871s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] 003fd243-5df0-4a5c-8516-ee64ddc926cf was raw, converting to raw {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:54 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 Jul 11 19:06:54 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:54 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.819s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Deleted volume successfully. Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81531487-6f0a-47ed-a59f-fe5fbfcbaca8 tempest-CreateVolumesFromSourceVolumeTest-44649215 None] Lock "cinder-0d1fe25b-7e08-464c-926d-b5fb834ffccf-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:54 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.903s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Deleted volume successfully. Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3b320627-1c7e-49c4-8352-70c0f8cae683 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-8c7788e3-e961-4166-a441-3847e7bcf53a-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-84ee56fd-28e0-4e3d-be47-1f760c88ad7e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-84ee56fd-28e0-4e3d-be47-1f760c88ad7e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-quobyte-84ee56fd-28e0-4e3d-be47-1f760c88ad7e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-84ee56fd-28e0-4e3d-be47-1f760c88ad7e" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ca5846-16a8-4659-9979-d93b4f3a8877]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:55 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525" returned: 0 in 1.066s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:55 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_003fd243-5df0-4a5c-8516-ee64ddc926cf_3cjx89kmdevstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:06:55 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 19:06:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:55 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 1G Jul 11 19:06:55 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:55 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e Jul 11 19:06:55 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:56 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 1G" returned: 0 in 0.883s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d248448a-e91e-40b9-a9f4-d1b31a1af086]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:56 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e" returned: 0 in 1.082s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:56 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e Jul 11 19:06:56 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:56 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 Jul 11 19:06:56 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:56 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-84ee56fd-28e0-4e3d-be47-1f760c88ad7e" returned: 0 in 0.780s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-84ee56fd-28e0-4e3d-be47-1f760c88ad7e" released by "delete_volume" :: held 1.918s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:56 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525" returned: 0 in 0.905s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created reservations ['47d5c926-7f07-43e1-9e01-7f9ec6cf86de', '9d872ce7-d7e3-4152-97c4-194123bd66ea', 'f0bebb12-5d41-4143-92b8-f1aebab70bc2', '16856692-b92e-44dc-a9f0-0876937eb79f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:57 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:57 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:57 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 Jul 11 19:06:57 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-eb50811d-50e0-44df-8c6f-4abec78bf42c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-eb50811d-50e0-44df-8c6f-4abec78bf42c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-quobyte-eb50811d-50e0-44df-8c6f-4abec78bf42c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-eb50811d-50e0-44df-8c6f-4abec78bf42c" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eb9ea4-cb86-4326-b5ff-cf8747c569be]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:57 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c Jul 11 19:06:57 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:58 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.893s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:06:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Deleted volume successfully. Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3d8cde5c-ee7f-487d-919c-c0edb45ce941 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-84ee56fd-28e0-4e3d-be47-1f760c88ad7e-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:58 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525" returned: 1 in 1.294s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Downloaded image 003fd243-5df0-4a5c-8516-ee64ddc926cf ((None, [{'url': 'file:///opt/stack/data/glance/images/003fd243-5df0-4a5c-8516-ee64ddc926cf', 'metadata': {}}])) to volume c60b8e7e-6174-43d9-84d0-8ff239c08525 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Temporary image 003fd243-5df0-4a5c-8516-ee64ddc926cf for user 52fe5ac5fa1b44e88c49d44e58e0a1c6 is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Marking volume c60b8e7e-6174-43d9-84d0-8ff239c08525 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Copying metadata from image 003fd243-5df0-4a5c-8516-ee64ddc926cf to c60b8e7e-6174-43d9-84d0-8ff239c08525. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Creating volume glance metadata for volume c60b8e7e-6174-43d9-84d0-8ff239c08525 backed by image 003fd243-5df0-4a5c-8516-ee64ddc926cf with: {'image_id': '003fd243-5df0-4a5c-8516-ee64ddc926cf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6e18b02bb19db290b1a1de844e6c83eb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f00034-a5d5-4187-932b-433e89bde299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60b8e7e-6174-43d9-84d0-8ff239c08525', 'volume_size': 1, 'image_id': '003fd243-5df0-4a5c-8516-ee64ddc926cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/003fd243-5df0-4a5c-8516-ee64ddc926cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e18b02bb19db290b1a1de844e6c83eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddad01ee7cb3478e94388ded73efdbc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c41e1186dc2042cfe4e19662dd1fece5563a63d9c2dc0fa4046fc4dbfb313b8db11567b4f66999e0d488e256cff6b17d17f36fa978e9176366de5d38bb0c565c', 'id': '003fd243-5df0-4a5c-8516-ee64ddc926cf', 'created_at': datetime.datetime(2026, 7, 11, 17, 6, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 6, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/003fd243-5df0-4a5c-8516-ee64ddc926cf/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be26d533-e19b-41a7-a368-8ccf9ca4c281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:06:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Volume volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 (c60b8e7e-6174-43d9-84d0-8ff239c08525): created successfully Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be26d533-e19b-41a7-a368-8ccf9ca4c281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Flow 'volume_create_manager' (1ac28d60-097f-4f87-b225-6638ee20fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:06:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8eb570b1-c370-4fa9-bf23-d32d310256a3 tempest-VolumeImageDependencyTests-654006099 None] Created volume successfully. Jul 11 19:06:58 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c" returned: 0 in 0.961s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:58 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c Jul 11 19:06:58 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-713fd5f0-c904-400b-b1a1-1895b59fbf71 tempest-ProjectAdminTests-1001352978 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 19:06:59 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Acquiring lock "cinder-c60b8e7e-6174-43d9-84d0-8ff239c08525-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-eb50811d-50e0-44df-8c6f-4abec78bf42c" returned: 0 in 0.657s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Lock "cinder-c60b8e7e-6174-43d9-84d0-8ff239c08525-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-eb50811d-50e0-44df-8c6f-4abec78bf42c" released by "delete_volume" :: held 1.691s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Acquiring lock "cinder-quobyte-c60b8e7e-6174-43d9-84d0-8ff239c08525" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Lock "cinder-quobyte-c60b8e7e-6174-43d9-84d0-8ff239c08525" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created reservations ['4883cb00-ccc9-4c6e-9945-71ffd0ca2a1c', '15873996-4ea5-4478-ba38-cafdf7beb79e', '337cebdc-d593-441f-a5d2-4c311747bd21', 'e5848674-0ced-4c61-a1dd-d84c41a56739'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[207b21dd-991b-44a7-95db-9553140c09a4]: (4, 'raw') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:06:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:06:59 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:06:59 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:06:59 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 Jul 11 19:06:59 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:00 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.668s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Deleted volume successfully. Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-99512f08-d2cd-4c08-b856-8fb59a16d80c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2f09b8ee-8ce4-4e3f-a129-bef87019e1a3 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-eb50811d-50e0-44df-8c6f-4abec78bf42c-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-99512f08-d2cd-4c08-b856-8fb59a16d80c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-quobyte-99512f08-d2cd-4c08-b856-8fb59a16d80c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-99512f08-d2cd-4c08-b856-8fb59a16d80c" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[abacbdd1-e4cd-443b-9267-8f9b308b15dc]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:00 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525" returned: 0 in 0.979s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:00 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c Jul 11 19:07:00 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:00 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 Jul 11 19:07:00 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:01 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525" returned: 1 in 0.922s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:07:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:01 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525 Jul 11 19:07:01 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:01 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c" returned: 0 in 1.008s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:01 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c Jul 11 19:07:01 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:02 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c60b8e7e-6174-43d9-84d0-8ff239c08525" returned: 0 in 0.856s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Lock "cinder-quobyte-c60b8e7e-6174-43d9-84d0-8ff239c08525" released by "delete_volume" :: held 2.831s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:02 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-99512f08-d2cd-4c08-b856-8fb59a16d80c" returned: 0 in 0.808s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-99512f08-d2cd-4c08-b856-8fb59a16d80c" released by "delete_volume" :: held 1.891s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Created reservations ['9564cd71-9f4f-479e-a480-d1b9bf350438', '63df0187-430d-42f6-ace2-0984f0fb5d1d', '7b28d811-8128-448a-87b7-fb76d282ce4c', '6f24e8f4-dbcf-4b08-b966-5553d1f58c83'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created reservations ['0abb52b0-a43d-479a-8511-866f004fd18e', 'b889abb6-744b-413d-8a7c-2224a087b4e5', 'f774b56f-f6b6-47e9-8236-5b9f9425c005', 'b45957c7-0d4d-4568-bbf0-b2baf8b67652'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:02 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:02 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:02 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:02 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-8a0f181c-a52d-4d4c-9d00-5cf534b97086-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-8a0f181c-a52d-4d4c-9d00-5cf534b97086-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-quobyte-d3510683-9eac-4ece-979c-c73bb1aeb8f0" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-d3510683-9eac-4ece-979c-c73bb1aeb8f0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-quobyte-8a0f181c-a52d-4d4c-9d00-5cf534b97086" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-8a0f181c-a52d-4d4c-9d00-5cf534b97086" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Deleting offline snapshot 8a0f181c-a52d-4d4c-9d00-5cf534b97086 of volume d3510683-9eac-4ece-979c-c73bb1aeb8f0 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] snapshot_file for this snap is: volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e12ced-34ce-42cd-a829-9f564ae5eea7]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:02 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 Jul 11 19:07:02 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:03 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.161s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Deleted volume successfully. Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3958b612-6745-4536-96c7-ddb1cb28c955 tempest-VolumeImageDependencyTests-654006099 None] Lock "cinder-c60b8e7e-6174-43d9-84d0-8ff239c08525-delete_volume" released by "delete_volume" :: held 4.334s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:03 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 1.273s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Deleted volume successfully. Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a764fd14-6896-4218-b35e-3d0785a3df76 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-99512f08-d2cd-4c08-b856-8fb59a16d80c-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:03 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086" returned: 0 in 0.979s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef627035-f5cf-441d-932c-814b9af081dc]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:03 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 Jul 11 19:07:03 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:04 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0" returned: 0 in 0.967s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:04 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 Jul 11 19:07:04 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (edc3c707-33ef-451c-bf08-2fa703608855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b368d37-c1d6-44ea-aa20-a3de82e5526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b368d37-c1d6-44ea-aa20-a3de82e5526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629443618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a756c1cb-a59b-4c09-bdec-4f771d9320c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:05Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d293138e-be18-4e0e-b48d-965085538984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d293138e-be18-4e0e-b48d-965085538984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a8f870-b526-46dd-8848-44ff43a90cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a8f870-b526-46dd-8848-44ff43a90cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a756c1cb-a59b-4c09-bdec-4f771d9320c8', 'volume_name': 'volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c3dae7-acdf-4843-a48d-b435c4cca1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c3dae7-acdf-4843-a48d-b435c4cca1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff29a16f-55f1-47bb-a357-f893017c014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Volume a756c1cb-a59b-4c09-bdec-4f771d9320c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8', 'volume_size': 1} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629443618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a756c1cb-a59b-4c09-bdec-4f771d9320c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:05Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Creating volume a756c1cb-a59b-4c09-bdec-4f771d9320c8 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:05 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:05 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 1073741824 Jul 11 19:07:05 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:05 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086" returned: 0 in 0.879s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:05 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086 Jul 11 19:07:05 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:06 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0.8a0f181c-a52d-4d4c-9d00-5cf534b97086" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-8a0f181c-a52d-4d4c-9d00-5cf534b97086" released by "_delete_snapshot" :: held 3.800s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-d3510683-9eac-4ece-979c-c73bb1aeb8f0" released by "delete_snapshot" :: held 3.838s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:06 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 1073741824" returned: 0 in 1.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:06 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Created reservations ['1ec94985-bf51-4d7e-9462-9d9cd935b397', '2d301c16-fbaa-497b-958e-586a4e47b30e', '5895a34a-8568-40c6-accc-14425089f270', '5125888d-e158-4bad-b193-d0671fd8e656'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:06 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 Jul 11 19:07:06 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Delete snapshot completed successfully. Jul 11 19:07:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-96439d6c-53f6-40ef-bdce-0beb074b3d15 tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-8a0f181c-a52d-4d4c-9d00-5cf534b97086-delete_snapshot" released by "delete_snapshot" :: held 4.063s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-d3510683-9eac-4ece-979c-c73bb1aeb8f0-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-d3510683-9eac-4ece-979c-c73bb1aeb8f0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "cinder-quobyte-d3510683-9eac-4ece-979c-c73bb1aeb8f0" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-d3510683-9eac-4ece-979c-c73bb1aeb8f0" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c997e7a-89b7-4013-919c-a51403a41d6e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:07 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 Jul 11 19:07:07 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:07 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8" returned: 0 in 0.771s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff29a16f-55f1-47bb-a357-f893017c014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b62c8f4-8ade-4b0b-a079-bf258d197e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Volume volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 (a756c1cb-a59b-4c09-bdec-4f771d9320c8): created successfully Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b62c8f4-8ade-4b0b-a079-bf258d197e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (edc3c707-33ef-451c-bf08-2fa703608855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-639f5b02-ee56-4c6c-b049-62295148ca1f tempest-ProjectReaderTests-124290530 None] Created volume successfully. Jul 11 19:07:07 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0" returned: 0 in 0.805s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:07 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0 Jul 11 19:07:07 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=163,cinder:UPDATE=213,cinder:INSERT=55,cinder:DELETE=19 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=142,cinder:UPDATE=217,cinder:INSERT=61,cinder:DELETE=20 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:07:08 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-d3510683-9eac-4ece-979c-c73bb1aeb8f0" returned: 0 in 0.846s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Creating offline snapshot b7c098e3-9255-46be-8ba5-f621d11da1db of volume a756c1cb-a59b-4c09-bdec-4f771d9320c8 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-quobyte-d3510683-9eac-4ece-979c-c73bb1aeb8f0" released by "delete_volume" :: held 1.743s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5510cf9b-792f-4916-8424-b2acd8e22df7]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:08 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Created reservations ['37b3460b-f506-407c-a3e2-9b09018e134b', 'b3fe3055-c76a-4a16-bee5-4905e6c2cce1', 'bea02a29-14f3-4775-baf7-a78fe6533f03', '76cbcb83-3fb4-4eff-bf92-88fae6a78661'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:09 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 Jul 11 19:07:09 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:09 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:09 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:09 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.717s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Deleted volume successfully. Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c97d384c-43d9-44b8-b3a7-0c6e02d706ef tempest-CreateVolumesFromSnapshotTest-75002915 None] Lock "cinder-d3510683-9eac-4ece-979c-c73bb1aeb8f0-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:09 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8" returned: 0 in 0.998s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:09 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db 1G Jul 11 19:07:09 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:10 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db 1G" returned: 0 in 1.103s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:10 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db Jul 11 19:07:10 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:11 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db" returned: 0 in 0.847s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:11 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db is being set with open permissions: ugo+rw Jul 11 19:07:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:11 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db Jul 11 19:07:11 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:12 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db" returned: 0 in 0.922s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:12 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.info Jul 11 19:07:12 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Flow 'volume_create_manager' (8b4f1d8d-3cfc-4d86-8e7e-62387cdae09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236b6ca6-a513-4ff7-95aa-b1de409afc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236b6ca6-a513-4ff7-95aa-b1de409afc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-167367047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80af0cfc-4c27-4370-b04d-0f2d613a0167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60da27a045894434859162a64de2e13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:13Z,use_quota=True,user_id='e7ce440c7bfa4c158fb10ddd39fd8618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d3c74d-76de-47e2-934f-2590fd32151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d3c74d-76de-47e2-934f-2590fd32151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21fdb68-5809-4a12-bb79-271c56c8aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21fdb68-5809-4a12-bb79-271c56c8aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80af0cfc-4c27-4370-b04d-0f2d613a0167', 'volume_name': 'volume-80af0cfc-4c27-4370-b04d-0f2d613a0167', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55038c5e-40fd-4709-880f-af80e807514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55038c5e-40fd-4709-880f-af80e807514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5688b1e-2e4c-4918-84d2-1289de776ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Volume 80af0cfc-4c27-4370-b04d-0f2d613a0167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80af0cfc-4c27-4370-b04d-0f2d613a0167', 'volume_size': 1} Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:13 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.info" returned: 0 in 0.771s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:13 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.info is being set with open permissions: ugo+rw Jul 11 19:07:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:13 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.info Jul 11 19:07:13 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:14 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.info" returned: 0 in 0.681s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.449s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-167367047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80af0cfc-4c27-4370-b04d-0f2d613a0167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60da27a045894434859162a64de2e13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:13Z,use_quota=True,user_id='e7ce440c7bfa4c158fb10ddd39fd8618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Creating volume 80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:14 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:14 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 1073741824 Jul 11 19:07:14 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0df601c1-a04d-480e-923b-9e627872f5d8 tempest-ProjectReaderTests-124290530 None] Create snapshot completed successfully Jul 11 19:07:14 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Flow 'volume_create_manager' (069a48de-a78b-49d6-80db-c58f400ae31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fb6e67-f9e2-46be-bc12-8e0c72e7849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fb6e67-f9e2-46be-bc12-8e0c72e7849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-251856079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85eeeaf5-dbaf-447a-881d-4894ea94381b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8262afd33d4befb2389039e63aa95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:15Z,use_quota=True,user_id='3473aacad3844f1481c671896d08fe3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddfe75b-ac82-4e15-b1e9-16aa5ae51f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddfe75b-ac82-4e15-b1e9-16aa5ae51f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43061366-65d4-45f2-9350-ddeb61b329f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43061366-65d4-45f2-9350-ddeb61b329f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85eeeaf5-dbaf-447a-881d-4894ea94381b', 'volume_name': 'volume-85eeeaf5-dbaf-447a-881d-4894ea94381b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be59582b-4aae-4523-8d08-8fd8c7f1753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be59582b-4aae-4523-8d08-8fd8c7f1753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4422c3c-05c4-42ba-8a86-d45329b17fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Volume 85eeeaf5-dbaf-447a-881d-4894ea94381b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85eeeaf5-dbaf-447a-881d-4894ea94381b', 'volume_size': 1} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:15 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 1073741824" returned: 0 in 0.923s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:15 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:15 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:15 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 Jul 11 19:07:15 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-b7c098e3-9255-46be-8ba5-f621d11da1db-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Lock "cinder-b7c098e3-9255-46be-8ba5-f621d11da1db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-a756c1cb-a59b-4c09-bdec-4f771d9320c8" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-a756c1cb-a59b-4c09-bdec-4f771d9320c8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-b7c098e3-9255-46be-8ba5-f621d11da1db" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-b7c098e3-9255-46be-8ba5-f621d11da1db" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Deleting offline snapshot b7c098e3-9255-46be-8ba5-f621d11da1db of volume a756c1cb-a59b-4c09-bdec-4f771d9320c8 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] snapshot_file for this snap is: volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[26176b43-88bb-41ec-af9a-372e5d291aa0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:15 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db Jul 11 19:07:15 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:15 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.858s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:07:16 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167" returned: 0 in 0.802s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.985s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-251856079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85eeeaf5-dbaf-447a-881d-4894ea94381b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8262afd33d4befb2389039e63aa95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:15Z,use_quota=True,user_id='3473aacad3844f1481c671896d08fe3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Creating volume 85eeeaf5-dbaf-447a-881d-4894ea94381b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:16 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5688b1e-2e4c-4918-84d2-1289de776ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80af0cfc-4c27-4370-b04d-0f2d613a0167', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:16 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b 1073741824 Jul 11 19:07:16 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90244298-a526-413e-9747-73240182a6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Volume volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 (80af0cfc-4c27-4370-b04d-0f2d613a0167): created successfully Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90244298-a526-413e-9747-73240182a6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Flow 'volume_create_manager' (8b4f1d8d-3cfc-4d86-8e7e-62387cdae09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1c3000fe-5c0d-4872-aafd-3396a8ec9cc3 tempest-VolumeDependencyTests-596315610 None] Created volume successfully. Jul 11 19:07:16 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db" returned: 0 in 1.007s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0966071-8ba6-4568-8c45-1639699a3e8d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:16 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 Jul 11 19:07:16 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:17 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b 1073741824" returned: 0 in 0.975s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:17 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b Jul 11 19:07:17 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:17 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8" returned: 0 in 0.973s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:17 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db Jul 11 19:07:17 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:17 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b" returned: 0 in 0.811s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.190s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Creating offline snapshot bca9d262-ce25-4bcc-a1de-aa7ef8e768ae of volume 80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4422c3c-05c4-42ba-8a86-d45329b17fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85eeeaf5-dbaf-447a-881d-4894ea94381b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6786fd77-569d-491e-b0fb-67ba2bc42c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34b94b0-af06-4543-afdb-69f1c099c92c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Volume volume-85eeeaf5-dbaf-447a-881d-4894ea94381b (85eeeaf5-dbaf-447a-881d-4894ea94381b): created successfully Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6786fd77-569d-491e-b0fb-67ba2bc42c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Flow 'volume_create_manager' (069a48de-a78b-49d6-80db-c58f400ae31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7ea00ef7-c811-4523-a5c2-a4f1ca427785 tempest-ProjectReaderTests-1820715748 None] Created volume successfully. Jul 11 19:07:18 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 Jul 11 19:07:18 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:18 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db" returned: 0 in 0.890s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:18 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db Jul 11 19:07:18 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "cinder-85eeeaf5-dbaf-447a-881d-4894ea94381b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Lock "cinder-85eeeaf5-dbaf-447a-881d-4894ea94381b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "cinder-quobyte-85eeeaf5-dbaf-447a-881d-4894ea94381b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Lock "cinder-quobyte-85eeeaf5-dbaf-447a-881d-4894ea94381b" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e7dd3c-f5eb-42c4-b81b-fe5f217e008a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:18 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167" returned: 0 in 0.916s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:18 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b Jul 11 19:07:18 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:18 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae 1G Jul 11 19:07:18 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:19 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8.b7c098e3-9255-46be-8ba5-f621d11da1db" returned: 0 in 0.833s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-b7c098e3-9255-46be-8ba5-f621d11da1db" released by "_delete_snapshot" :: held 3.853s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-a756c1cb-a59b-4c09-bdec-4f771d9320c8" released by "delete_snapshot" :: held 3.894s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Created reservations ['b4812318-a53c-4de1-ba71-27348e1113c4', 'a73f0fff-9888-4d9c-8dd6-c5239b0566f3', '06b05a82-47f3-4cbd-8896-ff788c0bd179', '0d13b479-87be-48cc-98e0-db94ce947712'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Delete snapshot completed successfully. Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e1dbb031-a8cf-425d-93bf-20c658ceda15 tempest-ProjectReaderTests-124290530 None] Lock "cinder-b7c098e3-9255-46be-8ba5-f621d11da1db-delete_snapshot" released by "delete_snapshot" :: held 4.083s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:19 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b" returned: 0 in 0.890s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:19 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b Jul 11 19:07:19 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-a756c1cb-a59b-4c09-bdec-4f771d9320c8-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Lock "cinder-a756c1cb-a59b-4c09-bdec-4f771d9320c8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-a756c1cb-a59b-4c09-bdec-4f771d9320c8" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-a756c1cb-a59b-4c09-bdec-4f771d9320c8" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32de817-c5b8-4b00-80ae-85e32f21d01b]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:19 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae 1G" returned: 0 in 1.079s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:19 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae Jul 11 19:07:19 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:20 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 Jul 11 19:07:20 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:20 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-85eeeaf5-dbaf-447a-881d-4894ea94381b" returned: 0 in 0.833s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Lock "cinder-quobyte-85eeeaf5-dbaf-447a-881d-4894ea94381b" released by "delete_volume" :: held 1.790s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Created reservations ['5b8c85be-0193-458a-95e3-0b5fcfd89a92', 'd2dc795a-81cd-4423-a526-f90c90331354', '978ebb72-11ec-40b6-a89a-32d9029b2011', '5d8166a7-4c1d-4638-a75d-3c1d91c6bf76'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:20 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:20 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:20 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8" returned: 0 in 0.885s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:20 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8 Jul 11 19:07:20 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" returned: 0 in 0.882s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:20 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae is being set with open permissions: ugo+rw Jul 11 19:07:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:20 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:20 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae Jul 11 19:07:20 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:21 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.786s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Deleted volume successfully. Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd87e5e0-7a8c-4e05-8238-d5d466ad6428 tempest-ProjectReaderTests-1820715748 None] Lock "cinder-85eeeaf5-dbaf-447a-881d-4894ea94381b-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:21 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-a756c1cb-a59b-4c09-bdec-4f771d9320c8" returned: 0 in 0.999s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:21 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" returned: 0 in 1.001s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-a756c1cb-a59b-4c09-bdec-4f771d9320c8" released by "delete_volume" :: held 1.991s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Flow 'volume_create_manager' (8d8a7841-4046-4e61-9707-7db90a362fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57958700-4736-459a-8141-b107b0b309af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57958700-4736-459a-8141-b107b0b309af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249286291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963f645b-0ff6-425c-97da-afb88845832f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8262afd33d4befb2389039e63aa95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:22Z,use_quota=True,user_id='3473aacad3844f1481c671896d08fe3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683a2aa5-5115-495d-abdf-82a056eda06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683a2aa5-5115-495d-abdf-82a056eda06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ccb9a3-ef02-4469-9409-c139327147eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ccb9a3-ef02-4469-9409-c139327147eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963f645b-0ff6-425c-97da-afb88845832f', 'volume_name': 'volume-963f645b-0ff6-425c-97da-afb88845832f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788b8226-bfe3-4f58-858f-764a96e651f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788b8226-bfe3-4f58-858f-764a96e651f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834f7435-c9e0-4757-8472-c4b9ef593724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Volume 963f645b-0ff6-425c-97da-afb88845832f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963f645b-0ff6-425c-97da-afb88845832f', 'volume_size': 1} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:21 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Created reservations ['f9cb96c0-46bb-4f1b-a81c-0df7611a8408', '6a8cc55d-cfa9-427a-8ce9-d01067931ba6', 'da2b1b32-a6a7-4229-921f-c0306e399168', '3eec4461-bf15-43fe-95b5-acad712e6983'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:21 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.info Jul 11 19:07:21 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:22 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:22 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:22 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.info" returned: 0 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:22 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.info is being set with open permissions: ugo+rw Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:22 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.info Jul 11 19:07:22 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:22 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Deleted volume successfully. Jul 11 19:07:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b88abd9a-8521-4344-a7c3-8d4a0c6f8f22 tempest-ProjectReaderTests-124290530 None] Lock "cinder-a756c1cb-a59b-4c09-bdec-4f771d9320c8-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:23 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.info" returned: 0 in 0.696s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.513s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249286291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963f645b-0ff6-425c-97da-afb88845832f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8262afd33d4befb2389039e63aa95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:22Z,use_quota=True,user_id='3473aacad3844f1481c671896d08fe3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Creating volume 963f645b-0ff6-425c-97da-afb88845832f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:23 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:23 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f 1073741824 Jul 11 19:07:23 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-926dbcb1-f40f-45fa-8d67-1129514570a6 tempest-VolumeDependencyTests-596315610 None] Create snapshot completed successfully Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (1f6a1e02-9155-4884-8b0c-655559684b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0fdf17-1049-4f79-8b03-ddf722f05c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0fdf17-1049-4f79-8b03-ddf722f05c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496400317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad00cd49-60ad-4dfa-9f9c-a508adb52c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:23Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fecd82f-0b3e-4d9d-a5ee-3893c4d5cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fecd82f-0b3e-4d9d-a5ee-3893c4d5cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086c292f-4f6b-4432-bc24-6785f0cb96df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086c292f-4f6b-4432-bc24-6785f0cb96df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad00cd49-60ad-4dfa-9f9c-a508adb52c3c', 'volume_name': 'volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a2d046-34c1-4388-ad1b-381c4e7548d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a2d046-34c1-4388-ad1b-381c4e7548d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f332608f-df63-47c1-a080-b0746e389399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Volume ad00cd49-60ad-4dfa-9f9c-a508adb52c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c', 'volume_size': 1} Jul 11 19:07:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:24 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f 1073741824" returned: 0 in 0.827s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:24 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f Jul 11 19:07:24 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Flow 'volume_create_manager' (1f71816a-855e-4758-97ed-93cabae5c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219d2921-ecb6-408e-b1ee-f93c279dfdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219d2921-ecb6-408e-b1ee-f93c279dfdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-557458527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab98e611-fa08-4280-8615-bb6d6eab66b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60da27a045894434859162a64de2e13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bca9d262-ce25-4bcc-a1de-aa7ef8e768ae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:25Z,use_quota=True,user_id='e7ce440c7bfa4c158fb10ddd39fd8618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f838807-cdb5-4d13-8335-b250d0c4036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f838807-cdb5-4d13-8335-b250d0c4036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b672f6-58f9-4426-8ca8-1677658d50d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b672f6-58f9-4426-8ca8-1677658d50d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ab98e611-fa08-4280-8615-bb6d6eab66b8', 'volume_name': 'volume-ab98e611-fa08-4280-8615-bb6d6eab66b8', 'volume_size': 1, 'snapshot_id': 'bca9d262-ce25-4bcc-a1de-aa7ef8e768ae'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f23aa9-ca38-426b-ba82-92a91344a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f23aa9-ca38-426b-ba82-92a91344a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26e047d-e1b2-4edd-9b0b-c1625c7cc97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Volume ab98e611-fa08-4280-8615-bb6d6eab66b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ab98e611-fa08-4280-8615-bb6d6eab66b8', 'volume_size': 1, 'snapshot_id': 'bca9d262-ce25-4bcc-a1de-aa7ef8e768ae'} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:24 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f" returned: 0 in 0.687s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.383s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496400317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad00cd49-60ad-4dfa-9f9c-a508adb52c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:23Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Creating volume ad00cd49-60ad-4dfa-9f9c-a508adb52c3c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:24 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:25 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c 1073741824 Jul 11 19:07:25 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834f7435-c9e0-4757-8472-c4b9ef593724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963f645b-0ff6-425c-97da-afb88845832f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08140240-d1c6-4890-b477-b789eeeb97e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Volume volume-963f645b-0ff6-425c-97da-afb88845832f (963f645b-0ff6-425c-97da-afb88845832f): created successfully Jul 11 19:07:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08140240-d1c6-4890-b477-b789eeeb97e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Flow 'volume_create_manager' (8d8a7841-4046-4e61-9707-7db90a362fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2ce31b52-ced8-41e2-9a8f-7d4d8ac774f1 tempest-ProjectReaderTests-1820715748 None] Created volume successfully. Jul 11 19:07:25 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c 1073741824" returned: 0 in 0.805s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:25 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c Jul 11 19:07:25 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "cinder-963f645b-0ff6-425c-97da-afb88845832f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Lock "cinder-963f645b-0ff6-425c-97da-afb88845832f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "cinder-quobyte-963f645b-0ff6-425c-97da-afb88845832f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Lock "cinder-quobyte-963f645b-0ff6-425c-97da-afb88845832f" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b687eb3-f62a-43f2-9a4b-cc9d59479233]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:26 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f Jul 11 19:07:26 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:26 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" returned: 0 in 0.668s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.777s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-quobyte-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae-ab98e611-fa08-4280-8615-bb6d6eab66b8" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae-ab98e611-fa08-4280-8615-bb6d6eab66b8" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Creating volume ab98e611-fa08-4280-8615-bb6d6eab66b8 from snapshot bca9d262-ce25-4bcc-a1de-aa7ef8e768ae {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-quobyte-ab98e611-fa08-4280-8615-bb6d6eab66b8" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f332608f-df63-47c1-a080-b0746e389399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6dda7e-1b65-4fa1-b2fe-0c32bda151f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-ab98e611-fa08-4280-8615-bb6d6eab66b8" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] snapshot: bca9d262-ce25-4bcc-a1de-aa7ef8e768ae, volume: ab98e611-fa08-4280-8615-bb6d6eab66b8, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 19:07:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Volume volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c (ad00cd49-60ad-4dfa-9f9c-a508adb52c3c): created successfully Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6dda7e-1b65-4fa1-b2fe-0c32bda151f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (1f6a1e02-9155-4884-8b0c-655559684b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-65e9f8cf-dbfe-4768-aba3-0831d8c9b707 tempest-ProjectReaderTests-124290530 None] Created volume successfully. Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded9ab79-eabb-4414-ab8a-5942c1fe4c2d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:26 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae Jul 11 19:07:26 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:26 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f" returned: 0 in 0.788s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:26 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f Jul 11 19:07:26 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:27 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" returned: 0 in 0.792s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80af0cfc-4c27-4370-b04d-0f2d613a0167(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e62c3-d361-4258-b8de-64db292e1e0e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:27 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 Jul 11 19:07:27 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:27 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-963f645b-0ff6-425c-97da-afb88845832f" returned: 0 in 0.654s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Lock "cinder-quobyte-963f645b-0ff6-425c-97da-afb88845832f" released by "delete_volume" :: held 1.491s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Created reservations ['0f6d1499-1903-4084-8091-d6d6b9ff7d2e', 'd25da3b9-db60-4903-bf3b-1f5595175ab4', '3b9ffe2d-8261-482c-974c-630a5551b6e0', '39bd715a-c536-4f2f-a92e-7ff94876ea22'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:27 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:27 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:28 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167" returned: 0 in 0.844s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:28 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 19:07:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:28 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 Jul 11 19:07:28 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:28 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.675s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:28 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Deleted volume successfully. Jul 11 19:07:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ca223a77-de05-44c7-9272-a3cb9c41a787 tempest-ProjectReaderTests-1820715748 None] Lock "cinder-963f645b-0ff6-425c-97da-afb88845832f-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:33 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8" returned: 0 in 5.404s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c9fd35-0e0d-4421-9976-45672c6051bc]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:33 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 Jul 11 19:07:33 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Flow 'volume_create_manager' (117e389b-7792-40fe-9e15-f1d16824d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8a3256-dcd2-455a-9b05-8c4820ee8e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8a3256-dcd2-455a-9b05-8c4820ee8e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041858450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160fc373-071a-4b96-bec8-097211a054ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee65b8d7557455483597a51916ca1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:34Z,use_quota=True,user_id='6dd15f853ccf4281b5ad97763016e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322a4a34-8765-4e68-81ab-ddb5d97e7821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322a4a34-8765-4e68-81ab-ddb5d97e7821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49466fe7-e642-4734-92c7-b36e7dc24478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49466fe7-e642-4734-92c7-b36e7dc24478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160fc373-071a-4b96-bec8-097211a054ef', 'volume_name': 'volume-160fc373-071a-4b96-bec8-097211a054ef', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb5cc35-bb92-4649-9fed-71c09e944d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb5cc35-bb92-4649-9fed-71c09e944d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1325de58-c5da-492d-b452-664935cf3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Volume 160fc373-071a-4b96-bec8-097211a054ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160fc373-071a-4b96-bec8-097211a054ef', 'volume_size': 1} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:34 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167" returned: 0 in 0.950s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:07:34 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Converted 1024.00 MB image at 189.44 MB/s Jul 11 19:07:34 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 is being set with open permissions: ugo+rw Jul 11 19:07:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:34 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 Jul 11 19:07:34 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:35 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8" returned: 0 in 0.623s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-ab98e611-fa08-4280-8615-bb6d6eab66b8" released by "_copy_volume_from_snapshot" :: held 8.733s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae-ab98e611-fa08-4280-8615-bb6d6eab66b8" released by "_create_volume_from_snapshot" :: held 8.783s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.805s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.382s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Creating offline snapshot de1b31c5-b1c0-47ca-8120-83748752fca6 of volume ad00cd49-60ad-4dfa-9f9c-a508adb52c3c {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26e047d-e1b2-4edd-9b0b-c1625c7cc97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab98e611-fa08-4280-8615-bb6d6eab66b8', 'volume_size': 1, 'snapshot_id': 'bca9d262-ce25-4bcc-a1de-aa7ef8e768ae'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b241d8a-ec08-46d6-bf11-7b5818556316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a00827-b94b-4c20-aad2-10350d228534]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Volume volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 (ab98e611-fa08-4280-8615-bb6d6eab66b8): created successfully Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b241d8a-ec08-46d6-bf11-7b5818556316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Flow 'volume_create_manager' (1f71816a-855e-4758-97ed-93cabae5c974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c9c6e913-6274-46f9-a8c4-c6b3a5f5e159 tempest-VolumeDependencyTests-596315610 None] Created volume successfully. Jul 11 19:07:35 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c Jul 11 19:07:35 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-quobyte-80af0cfc-4c27-4370-b04d-0f2d613a0167" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-80af0cfc-4c27-4370-b04d-0f2d613a0167" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-quobyte-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Deleting offline snapshot bca9d262-ce25-4bcc-a1de-aa7ef8e768ae of volume 80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] snapshot_file for this snap is: volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5551a6f-fa5a-4477-8dd4-8757173d5031]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:35 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae Jul 11 19:07:35 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:36 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" returned: 0 in 0.772s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:36 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 1G Jul 11 19:07:36 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:36 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" returned: 0 in 0.778s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80af0cfc-4c27-4370-b04d-0f2d613a0167(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:07:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d3ebe0-d756-44b4-9321-e514e413fe6d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:36 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 Jul 11 19:07:36 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:36 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 1G" returned: 0 in 0.798s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:36 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 Jul 11 19:07:36 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:37 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167" returned: 0 in 0.762s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:37 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae Jul 11 19:07:37 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:37 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6" returned: 0 in 0.678s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:37 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 is being set with open permissions: ugo+rw Jul 11 19:07:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:37 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 Jul 11 19:07:37 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:37 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" returned: 0 in 0.706s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:37 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae Jul 11 19:07:37 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:38 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6" returned: 0 in 0.658s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:38 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.info Jul 11 19:07:38 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:38 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167.bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" returned: 0 in 0.648s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae" released by "_delete_snapshot" :: held 2.990s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-80af0cfc-4c27-4370-b04d-0f2d613a0167" released by "delete_snapshot" :: held 3.012s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:38 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Created reservations ['df1bad42-9f06-467a-b53e-d8e961201ca4', '7c96d2ab-0cff-4a9d-bd4a-d563be3f81c2', 'ef8ac23a-245d-422e-8005-2e3f75e030b9', '6f45d16a-e316-4a40-a7c8-11eda6b35d4a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Delete snapshot completed successfully. Jul 11 19:07:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-01bb939a-822c-4fb7-873b-cffecad7e161 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-bca9d262-ce25-4bcc-a1de-aa7ef8e768ae-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:39 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.info" returned: 0 in 0.650s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:39 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.info is being set with open permissions: ugo+rw Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:39 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.info Jul 11 19:07:39 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:39 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.info" returned: 0 in 0.653s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.058s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041858450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160fc373-071a-4b96-bec8-097211a054ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee65b8d7557455483597a51916ca1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:34Z,use_quota=True,user_id='6dd15f853ccf4281b5ad97763016e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Creating volume 160fc373-071a-4b96-bec8-097211a054ef {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:39 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:39 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef 1073741824 Jul 11 19:07:39 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-df57531d-a4c5-4fc8-9929-5a34d0fc1a2d tempest-ProjectReaderTests-124290530 None] Create snapshot completed successfully Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-80af0cfc-4c27-4370-b04d-0f2d613a0167-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-80af0cfc-4c27-4370-b04d-0f2d613a0167-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-quobyte-80af0cfc-4c27-4370-b04d-0f2d613a0167" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-80af0cfc-4c27-4370-b04d-0f2d613a0167" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5de319-7466-4527-aeae-654ba2f5d943]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:40 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 Jul 11 19:07:40 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:40 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef 1073741824" returned: 0 in 0.805s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:40 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef Jul 11 19:07:40 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-de1b31c5-b1c0-47ca-8120-83748752fca6-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Lock "cinder-de1b31c5-b1c0-47ca-8120-83748752fca6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-de1b31c5-b1c0-47ca-8120-83748752fca6" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-de1b31c5-b1c0-47ca-8120-83748752fca6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Deleting offline snapshot de1b31c5-b1c0-47ca-8120-83748752fca6 of volume ad00cd49-60ad-4dfa-9f9c-a508adb52c3c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] snapshot_file for this snap is: volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcaa59b-000c-4cc1-b306-84e6e8046183]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:40 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167" returned: 0 in 0.859s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:40 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167 Jul 11 19:07:40 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:40 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 Jul 11 19:07:40 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:41 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef" returned: 0 in 0.716s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1325de58-c5da-492d-b452-664935cf3606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160fc373-071a-4b96-bec8-097211a054ef', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f74f55-d71b-4db2-af0a-31707ca2a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Volume volume-160fc373-071a-4b96-bec8-097211a054ef (160fc373-071a-4b96-bec8-097211a054ef): created successfully Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f74f55-d71b-4db2-af0a-31707ca2a04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Flow 'volume_create_manager' (117e389b-7792-40fe-9e15-f1d16824d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5a172c95-a36f-4506-8350-adc14c60ae40 tempest-ProjectReaderTests-338098337 None] Created volume successfully. Jul 11 19:07:41 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-80af0cfc-4c27-4370-b04d-0f2d613a0167" returned: 0 in 0.693s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:41 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6" returned: 0 in 0.785s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-80af0cfc-4c27-4370-b04d-0f2d613a0167" released by "delete_volume" :: held 1.620s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f699247-55ca-49e9-b520-e7a12b176776]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Created reservations ['29923121-946c-426d-a27d-528a59f7a213', '99b972de-379e-4914-9a0f-05a8fc0a3926', '41355999-1cd6-448b-be9d-363c7b4a0045', 'f5c42b89-59f5-4407-8b85-c17f4f51d40e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:41 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c Jul 11 19:07:41 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:41 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:41 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-ab98e611-fa08-4280-8615-bb6d6eab66b8-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Lock "cinder-ab98e611-fa08-4280-8615-bb6d6eab66b8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Acquiring lock "cinder-quobyte-ab98e611-fa08-4280-8615-bb6d6eab66b8" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-ab98e611-fa08-4280-8615-bb6d6eab66b8" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[25872a2d-1440-4280-80f7-0c86ecd3d181]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Acquiring lock "cinder-160fc373-071a-4b96-bec8-097211a054ef-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Lock "cinder-160fc373-071a-4b96-bec8-097211a054ef-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Acquiring lock "cinder-quobyte-160fc373-071a-4b96-bec8-097211a054ef" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Lock "cinder-quobyte-160fc373-071a-4b96-bec8-097211a054ef" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:42 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:42 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:42 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Deleted volume successfully. Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3072b26b-4918-4b6e-8776-dee2dda2913e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:42 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0724dfe3-c191-457b-bd5f-4389b48a3116 tempest-VolumeDependencyTests-596315610 None] Lock "cinder-80af0cfc-4c27-4370-b04d-0f2d613a0167-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" returned: 0 in 0.891s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:42 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 Jul 11 19:07:42 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:42 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef Jul 11 19:07:42 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:43 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8" returned: 0 in 0.809s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:43 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8 Jul 11 19:07:43 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:43 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:43 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:43 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef Jul 11 19:07:43 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6" returned: 0 in 0.784s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:43 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6 Jul 11 19:07:43 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:43 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ab98e611-fa08-4280-8615-bb6d6eab66b8" returned: 0 in 0.671s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Lock "cinder-quobyte-ab98e611-fa08-4280-8615-bb6d6eab66b8" released by "delete_volume" :: held 1.542s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Created reservations ['fcfbb919-9afd-43f5-a33f-d0e720f6a02d', '5462c269-4ea9-46a3-9cd1-ba094ea9c59e', '827ab965-21a8-4c10-9d10-6bcad597d723', '8481ef04-c899-4f7e-b55d-996b6f3efdab'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:43 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-160fc373-071a-4b96-bec8-097211a054ef" returned: 0 in 0.691s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:43 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:43 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:43 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Lock "cinder-quobyte-160fc373-071a-4b96-bec8-097211a054ef" released by "delete_volume" :: held 1.546s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c.de1b31c5-b1c0-47ca-8120-83748752fca6" returned: 0 in 0.682s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-de1b31c5-b1c0-47ca-8120-83748752fca6" released by "_delete_snapshot" :: held 3.232s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" released by "delete_snapshot" :: held 3.258s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Created reservations ['61511152-b148-41ec-aa1a-9b4f567abe88', '6bfc6703-7dc1-448b-9d3c-1ed379b01d4b', '947766fd-f216-436f-9870-8ac4112171fc', '1c9325e5-9966-4a47-8f32-67ca50e86c42'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Created reservations ['13e85fa5-5461-44f3-9eae-0c15dacdf7ec', '15f41ee4-18c5-4328-9101-a898bd61327d', '861dc1f7-1297-4753-8547-3dc6423cadd4', 'dc07b0a7-b461-42b8-80f5-b5a3746a5f5e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Delete snapshot completed successfully. Jul 11 19:07:44 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:44 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6cb0fb5b-d4f6-4f37-95dc-26736c1e3d71 tempest-ProjectReaderTests-124290530 None] Lock "cinder-de1b31c5-b1c0-47ca-8120-83748752fca6-delete_snapshot" released by "delete_snapshot" :: held 3.455s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:44 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.692s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Deleted volume successfully. Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-eaf9f59d-65c9-49d9-b78d-c4ef14b7dcca tempest-VolumeDependencyTests-596315610 None] Lock "cinder-ab98e611-fa08-4280-8615-bb6d6eab66b8-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:44 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.712s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Deleted volume successfully. Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed879293-cdb7-43e4-8ec6-9d1b7722dbac tempest-ProjectReaderTests-338098337 None] Lock "cinder-160fc373-071a-4b96-bec8-097211a054ef-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Lock "cinder-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0a0679-8177-43be-a243-22b090367421]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Flow 'volume_create_manager' (5f4c4ccc-e1fe-4e7d-a166-7a49dfe5c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd93868-0ac8-4beb-81c5-0eb2b86495b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd93868-0ac8-4beb-81c5-0eb2b86495b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385136348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dbbf51-3621-4c5e-8311-d0ddd42a6d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee65b8d7557455483597a51916ca1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:45Z,use_quota=True,user_id='6dd15f853ccf4281b5ad97763016e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bde260-1aa2-4388-9f20-97db84144e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bde260-1aa2-4388-9f20-97db84144e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4879303a-83f4-4a39-a47a-5957f2e1aec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4879303a-83f4-4a39-a47a-5957f2e1aec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9dbbf51-3621-4c5e-8311-d0ddd42a6d04', 'volume_name': 'volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9482e1e0-17b8-4500-bf99-06abc772fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9482e1e0-17b8-4500-bf99-06abc772fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0862397f-1c04-446b-abe4-7df6d3f0ab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Volume c9dbbf51-3621-4c5e-8311-d0ddd42a6d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04', 'volume_size': 1} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385136348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dbbf51-3621-4c5e-8311-d0ddd42a6d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee65b8d7557455483597a51916ca1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:45Z,use_quota=True,user_id='6dd15f853ccf4281b5ad97763016e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Creating volume c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:45 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c Jul 11 19:07:45 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:45 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:45 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 1073741824 Jul 11 19:07:45 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:45 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" returned: 0 in 0.928s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:46 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c Jul 11 19:07:46 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:46 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 1073741824" returned: 0 in 0.997s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:46 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 Jul 11 19:07:46 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:46 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" returned: 0 in 0.726s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c" released by "delete_volume" :: held 1.728s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Created reservations ['baf7b8e2-fe8e-49eb-a9b6-4d2c71f67508', 'a1df9448-e28f-4d8f-8275-46c7d2a1d44d', '57b380ab-2a22-4410-8f7c-980f7e8fad30', 'a5350b5e-2670-4aba-940f-67c11d36da2d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:46 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:46 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:46 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0862397f-1c04-446b-abe4-7df6d3f0ab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907a107e-dbad-4030-b7de-ff08c17624c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Volume volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 (c9dbbf51-3621-4c5e-8311-d0ddd42a6d04): created successfully Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907a107e-dbad-4030-b7de-ff08c17624c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Flow 'volume_create_manager' (5f4c4ccc-e1fe-4e7d-a166-7a49dfe5c563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fdacc882-3676-441a-82d5-9080618a8334 tempest-ProjectReaderTests-338098337 None] Created volume successfully. Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Acquiring lock "cinder-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Lock "cinder-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Acquiring lock "cinder-quobyte-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Lock "cinder-quobyte-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[375908ee-55d2-46aa-87dc-3ffcf50bf812]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:47 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 Jul 11 19:07:47 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:47 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.817s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Deleted volume successfully. Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-24e05351-e0b9-430a-90c5-0ce47f8a1578 tempest-ProjectReaderTests-124290530 None] Lock "cinder-ad00cd49-60ad-4dfa-9f9c-a508adb52c3c-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Flow 'volume_create_manager' (f21c273a-1596-40f2-a518-e835f2d7dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6cbc5e-3e9c-4c91-8a3f-fbf09ed07362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6cbc5e-3e9c-4c91-8a3f-fbf09ed07362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31db6052-f4d6-4b1d-80c3-d83b8cad474f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9746a65ffb43468d8f13e00cb59ea037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:48Z,use_quota=True,user_id='62db8a13ddcf472ca6164d9398e0fd57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf890d7-b398-4cf8-90ce-175a51101dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf890d7-b398-4cf8-90ce-175a51101dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcf52ad-e53c-4c46-8263-7a3c1d96f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcf52ad-e53c-4c46-8263-7a3c1d96f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31db6052-f4d6-4b1d-80c3-d83b8cad474f', 'volume_name': 'volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca9566e-bcf3-4d4b-af5f-01848ade7f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca9566e-bcf3-4d4b-af5f-01848ade7f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2188289f-efc3-4cfc-89b3-809c375bfd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Volume 31db6052-f4d6-4b1d-80c3-d83b8cad474f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f', 'volume_size': 1} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31db6052-f4d6-4b1d-80c3-d83b8cad474f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9746a65ffb43468d8f13e00cb59ea037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:48Z,use_quota=True,user_id='62db8a13ddcf472ca6164d9398e0fd57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Creating volume 31db6052-f4d6-4b1d-80c3-d83b8cad474f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:48 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:48 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f 1073741824 Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:48 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (0e1b9a4d-b8ed-431b-8faa-936c97a1b728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0eee61-680c-4126-8f42-fb040654f379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0eee61-680c-4126-8f42-fb040654f379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467834355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a23933-fe9d-49d1-89db-614c2d2761d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:48Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17622a64-e1f0-40ed-be25-c285adb034ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17622a64-e1f0-40ed-be25-c285adb034ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c837c13f-e38a-4b87-bc15-6a0f4617b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c837c13f-e38a-4b87-bc15-6a0f4617b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a23933-fe9d-49d1-89db-614c2d2761d9', 'volume_name': 'volume-f8a23933-fe9d-49d1-89db-614c2d2761d9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ab3a27-86f5-4c7a-979b-34f68e2ee8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ab3a27-86f5-4c7a-979b-34f68e2ee8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cede1e5-2168-4d1a-8031-db508b159c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Volume f8a23933-fe9d-49d1-89db-614c2d2761d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a23933-fe9d-49d1-89db-614c2d2761d9', 'volume_size': 1} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:48 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04" returned: 0 in 0.917s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:48 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04 Jul 11 19:07:48 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:48 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f 1073741824" returned: 0 in 0.871s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:48 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04" returned: 0 in 0.705s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:48 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f Jul 11 19:07:48 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Lock "cinder-quobyte-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04" released by "delete_volume" :: held 1.666s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Created reservations ['b3f0c337-cf9d-4f67-961a-78b342ea0cd9', 'a2c71093-4536-4a9a-8949-c44971a9a9e6', 'a1d316e3-d90b-4373-bac9-66c187bb380a', 'cf438abf-0df0-41a8-8d4d-3dee705cc93e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:49 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:49 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:49 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f" returned: 0 in 0.652s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467834355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a23933-fe9d-49d1-89db-614c2d2761d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:48Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Creating volume f8a23933-fe9d-49d1-89db-614c2d2761d9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:49 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 1073741824 Jul 11 19:07:49 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2188289f-efc3-4cfc-89b3-809c375bfd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf495c6-1077-4f79-8b6c-cd54b5955cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Volume volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f (31db6052-f4d6-4b1d-80c3-d83b8cad474f): created successfully Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf495c6-1077-4f79-8b6c-cd54b5955cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Flow 'volume_create_manager' (f21c273a-1596-40f2-a518-e835f2d7dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4eca8786-8f2c-4a0a-a863-518e52bdb890 tempest-CinderUnicodeTest-1563157689 None] Created volume successfully. Jul 11 19:07:49 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.774s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Deleted volume successfully. Jul 11 19:07:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfc954b2-e263-4100-ab6f-1f3b907f8a4d tempest-ProjectReaderTests-338098337 None] Lock "cinder-c9dbbf51-3621-4c5e-8311-d0ddd42a6d04-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Flow 'volume_create_manager' (69e07e69-42b5-47af-8bf3-60b21c5fc46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcfc2c7-6230-4ded-ae3d-d766a3370245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcfc2c7-6230-4ded-ae3d-d766a3370245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629836393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5e187c-91a5-416a-8610-ec97c584cb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee65b8d7557455483597a51916ca1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:50Z,use_quota=True,user_id='6dd15f853ccf4281b5ad97763016e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c077b403-afe5-4747-a705-8810c5c42f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c077b403-afe5-4747-a705-8810c5c42f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8bc849-aea5-4f44-8ec9-affd86a60bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8bc849-aea5-4f44-8ec9-affd86a60bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5e187c-91a5-416a-8610-ec97c584cb2b', 'volume_name': 'volume-2f5e187c-91a5-416a-8610-ec97c584cb2b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd328833-9a62-4393-8fb1-9d8cb372f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd328833-9a62-4393-8fb1-9d8cb372f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c64b4fe-9677-46c8-93c9-ef0ee8fe4244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Volume 2f5e187c-91a5-416a-8610-ec97c584cb2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5e187c-91a5-416a-8610-ec97c584cb2b', 'volume_size': 1} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 1073741824" returned: 0 in 0.958s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Flow 'volume_create_manager' (fbf83b58-51de-4c63-9c5b-f066cb261775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e851b137-3109-48d0-a3d4-6fdbf5e91c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e851b137-3109-48d0-a3d4-6fdbf5e91c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-583759881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7ef685-4953-42d6-8f8b-4a76fcba1626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9746a65ffb43468d8f13e00cb59ea037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:50Z,use_quota=True,user_id='62db8a13ddcf472ca6164d9398e0fd57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262bf4e3-37fd-4a9b-9658-6a57029e57bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262bf4e3-37fd-4a9b-9658-6a57029e57bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e89fd8-95bf-4db7-b038-a5bcb6e8f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e89fd8-95bf-4db7-b038-a5bcb6e8f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd7ef685-4953-42d6-8f8b-4a76fcba1626', 'volume_name': 'volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b71146f-2e16-4b3a-ada4-fb18c9b05e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b71146f-2e16-4b3a-ada4-fb18c9b05e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbeed4b-6356-474c-9ebc-584b26ac5bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Volume dd7ef685-4953-42d6-8f8b-4a76fcba1626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626', 'volume_size': 1} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:50 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 Jul 11 19:07:50 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:51 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9" returned: 0 in 0.654s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629836393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5e187c-91a5-416a-8610-ec97c584cb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee65b8d7557455483597a51916ca1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:50Z,use_quota=True,user_id='6dd15f853ccf4281b5ad97763016e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Creating volume 2f5e187c-91a5-416a-8610-ec97c584cb2b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:51 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cede1e5-2168-4d1a-8031-db508b159c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a23933-fe9d-49d1-89db-614c2d2761d9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:51 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b 1073741824 Jul 11 19:07:51 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e856afe-97d4-4e70-88d8-e7f1889bc523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Volume volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 (f8a23933-fe9d-49d1-89db-614c2d2761d9): created successfully Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e856afe-97d4-4e70-88d8-e7f1889bc523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (0e1b9a4d-b8ed-431b-8faa-936c97a1b728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-14d71b1d-5c2b-44a4-90e5-af99ba9b27c2 tempest-ProjectReaderTests-124290530 None] Created volume successfully. Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:52 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b 1073741824" returned: 0 in 0.849s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:52 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b Jul 11 19:07:52 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:52 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.213s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-583759881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7ef685-4953-42d6-8f8b-4a76fcba1626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9746a65ffb43468d8f13e00cb59ea037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:50Z,use_quota=True,user_id='62db8a13ddcf472ca6164d9398e0fd57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Creating volume dd7ef685-4953-42d6-8f8b-4a76fcba1626 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:07:52 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:52 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 1073741824 Jul 11 19:07:52 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c64b4fe-9677-46c8-93c9-ef0ee8fe4244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5e187c-91a5-416a-8610-ec97c584cb2b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ce32c4-7ee9-4223-ad21-1b686be35593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:52 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Volume volume-2f5e187c-91a5-416a-8610-ec97c584cb2b (2f5e187c-91a5-416a-8610-ec97c584cb2b): created successfully Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ce32c4-7ee9-4223-ad21-1b686be35593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Flow 'volume_create_manager' (69e07e69-42b5-47af-8bf3-60b21c5fc46c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b37191c8-2766-4ca2-816c-c73946125d33 tempest-ProjectReaderTests-338098337 None] Created volume successfully. Jul 11 19:07:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Acquiring lock "cinder-2f5e187c-91a5-416a-8610-ec97c584cb2b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Lock "cinder-2f5e187c-91a5-416a-8610-ec97c584cb2b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Acquiring lock "cinder-quobyte-2f5e187c-91a5-416a-8610-ec97c584cb2b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Lock "cinder-quobyte-2f5e187c-91a5-416a-8610-ec97c584cb2b" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[547e6045-49f6-43a0-8b01-bac75911441a]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:53 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b Jul 11 19:07:53 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:53 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 1073741824" returned: 0 in 0.851s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:53 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 Jul 11 19:07:53 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:54 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b" returned: 0 in 0.788s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:54 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b Jul 11 19:07:54 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:54 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626" returned: 0 in 0.647s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.279s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbeed4b-6356-474c-9ebc-584b26ac5bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08085dfc-379c-48b0-a5d5-8e15da7b555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Creating offline snapshot f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 of volume f8a23933-fe9d-49d1-89db-614c2d2761d9 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:07:54 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Volume volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 (dd7ef685-4953-42d6-8f8b-4a76fcba1626): created successfully Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08085dfc-379c-48b0-a5d5-8e15da7b555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Flow 'volume_create_manager' (fbf83b58-51de-4c63-9c5b-f066cb261775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1171ba2c-52ce-440d-979e-e25a2ba50f85]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-70b60fc1-6f85-41e3-9c9d-8dfada205c76 tempest-CinderUnicodeTest-1563157689 None] Created volume successfully. Jul 11 19:07:54 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 Jul 11 19:07:54 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:55 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-2f5e187c-91a5-416a-8610-ec97c584cb2b" returned: 0 in 0.706s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Lock "cinder-quobyte-2f5e187c-91a5-416a-8610-ec97c584cb2b" released by "delete_volume" :: held 1.532s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Created reservations ['58008c31-f7de-42ec-9978-a3ca1015e30f', '1b67994e-2045-402d-8434-a9efced45f25', '86aa2348-da83-4938-8b1f-d558eded96fc', 'a517fb35-6059-4c79-bec0-36d1a53551d6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:55 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:07:55 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:55 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9" returned: 0 in 0.869s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:55 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 1G Jul 11 19:07:55 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:55 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.674s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:07:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Deleted volume successfully. Jul 11 19:07:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7f0c6412-bcc4-4f6d-9e03-eb357e905e7e tempest-ProjectReaderTests-338098337 None] Lock "cinder-2f5e187c-91a5-416a-8610-ec97c584cb2b-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Flow 'volume_create_manager' (148cf47d-d470-4cfd-b98c-6ca132a90d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4597650-e46b-4dea-9109-1c4a9285fcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4597650-e46b-4dea-9109-1c4a9285fcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231117615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b26a175-a92f-4df7-b1be-6e8202814c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee65b8d7557455483597a51916ca1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:56Z,use_quota=True,user_id='6dd15f853ccf4281b5ad97763016e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d83a79d-c3f0-4884-ad08-b1f4a2a79bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d83a79d-c3f0-4884-ad08-b1f4a2a79bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32629cce-548b-4b73-8894-d15e91320c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32629cce-548b-4b73-8894-d15e91320c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b26a175-a92f-4df7-b1be-6e8202814c8f', 'volume_name': 'volume-0b26a175-a92f-4df7-b1be-6e8202814c8f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:56 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8d78d5-7dc9-4315-a0c1-7be085038d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8d78d5-7dc9-4315-a0c1-7be085038d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba38ac43-6121-429a-9ed3-5f90e5a8c591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:07:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Volume 0b26a175-a92f-4df7-b1be-6e8202814c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b26a175-a92f-4df7-b1be-6e8202814c8f', 'volume_size': 1} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 1G" returned: 0 in 0.900s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:56 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 Jul 11 19:07:56 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:56 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3" returned: 0 in 0.679s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:56 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 is being set with open permissions: ugo+rw Jul 11 19:07:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:56 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 Jul 11 19:07:56 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:57 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:57 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.info Jul 11 19:07:57 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:58 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.info" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:58 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.info is being set with open permissions: ugo+rw Jul 11 19:07:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:58 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.info Jul 11 19:07:58 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:58 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.info" returned: 0 in 0.624s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.460s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:07:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.986s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:07:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Creating offline snapshot d9478289-bcdc-4b66-9df3-0356b7533772 of volume dd7ef685-4953-42d6-8f8b-4a76fcba1626 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:07:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9cbd0c76-18c7-471e-b716-c3b26e80e3c0 tempest-ProjectReaderTests-124290530 None] Create snapshot completed successfully Jul 11 19:07:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a806a-4af0-4960-b228-fde02dfd8eb9]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:59 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 Jul 11 19:07:59 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-f0b5b52a-50da-4cb9-9ef9-cf750ef509e3-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Lock "cinder-f0b5b52a-50da-4cb9-9ef9-cf750ef509e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-f8a23933-fe9d-49d1-89db-614c2d2761d9" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-f8a23933-fe9d-49d1-89db-614c2d2761d9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-f0b5b52a-50da-4cb9-9ef9-cf750ef509e3" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-f0b5b52a-50da-4cb9-9ef9-cf750ef509e3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Deleting offline snapshot f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 of volume f8a23933-fe9d-49d1-89db-614c2d2761d9 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] snapshot_file for this snap is: volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4724a5-6f9c-46fe-86fa-b7117160b3e5]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:59 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 Jul 11 19:07:59 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:07:59 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626" returned: 0 in 0.781s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:07:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:07:59 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 1G Jul 11 19:07:59 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:00 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3" returned: 0 in 0.769s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8a23933-fe9d-49d1-89db-614c2d2761d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:08:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc90c82e-4b66-4495-afbb-ae17f9b23bb8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:00 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 Jul 11 19:08:00 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:00 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 1G" returned: 0 in 0.836s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:00 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 Jul 11 19:08:00 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:01 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9" returned: 0 in 0.769s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:01 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 Jul 11 19:08:01 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:01 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772" returned: 0 in 0.702s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:01 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 is being set with open permissions: ugo+rw Jul 11 19:08:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:01 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 Jul 11 19:08:01 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:01 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3" returned: 0 in 0.737s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:01 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3 Jul 11 19:08:01 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:01 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772" returned: 0 in 0.666s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:01 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.info Jul 11 19:08:01 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:02 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9.f0b5b52a-50da-4cb9-9ef9-cf750ef509e3" returned: 0 in 0.659s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-f0b5b52a-50da-4cb9-9ef9-cf750ef509e3" released by "_delete_snapshot" :: held 3.021s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-f8a23933-fe9d-49d1-89db-614c2d2761d9" released by "delete_snapshot" :: held 3.044s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:02 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Created reservations ['510765b3-e7af-4b43-81a3-5f3b9e36f22d', 'c4b81c29-5384-47d2-bb71-82c51b45e4f2', '8158b420-d64c-4ac7-815d-ec222950b1de', 'e7bee3f7-2473-47a9-8118-e831820e3fdb'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:02 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.info" returned: 0 in 0.657s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:02 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.info is being set with open permissions: ugo+rw Jul 11 19:08:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:02 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.info Jul 11 19:08:02 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Delete snapshot completed successfully. Jul 11 19:08:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0cec907-4e4e-426a-be40-d9e8f4958c24 tempest-ProjectReaderTests-124290530 None] Lock "cinder-f0b5b52a-50da-4cb9-9ef9-cf750ef509e3-delete_snapshot" released by "delete_snapshot" :: held 3.216s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:03 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.info" returned: 0 in 0.656s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.391s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.022s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231117615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b26a175-a92f-4df7-b1be-6e8202814c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee65b8d7557455483597a51916ca1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:07:56Z,use_quota=True,user_id='6dd15f853ccf4281b5ad97763016e077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Creating volume 0b26a175-a92f-4df7-b1be-6e8202814c8f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:08:03 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:03 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f 1073741824 Jul 11 19:08:03 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-275aa619-edb5-4c16-a3ea-9c8bfae0f5a9 tempest-CinderUnicodeTest-1563157689 None] Create snapshot completed successfully Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-f8a23933-fe9d-49d1-89db-614c2d2761d9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Lock "cinder-f8a23933-fe9d-49d1-89db-614c2d2761d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-f8a23933-fe9d-49d1-89db-614c2d2761d9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-f8a23933-fe9d-49d1-89db-614c2d2761d9" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c9437-272c-4436-944c-526c701b8177]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:03 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 Jul 11 19:08:03 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:04 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f 1073741824" returned: 0 in 0.819s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:04 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f Jul 11 19:08:04 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "cinder-d9478289-bcdc-4b66-9df3-0356b7533772-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-d9478289-bcdc-4b66-9df3-0356b7533772-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "cinder-quobyte-dd7ef685-4953-42d6-8f8b-4a76fcba1626" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-quobyte-dd7ef685-4953-42d6-8f8b-4a76fcba1626" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "cinder-quobyte-d9478289-bcdc-4b66-9df3-0356b7533772" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-quobyte-d9478289-bcdc-4b66-9df3-0356b7533772" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Deleting offline snapshot d9478289-bcdc-4b66-9df3-0356b7533772 of volume dd7ef685-4953-42d6-8f8b-4a76fcba1626 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] snapshot_file for this snap is: volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[82466c6e-a8a9-4953-82c7-89ff40fd207d]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:04 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 Jul 11 19:08:04 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:04 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9" returned: 0 in 0.797s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:04 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9 Jul 11 19:08:04 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:04 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f" returned: 0 in 0.691s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba38ac43-6121-429a-9ed3-5f90e5a8c591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b26a175-a92f-4df7-b1be-6e8202814c8f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f588d3e-a6fe-407c-b4ed-05d41a84d20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Volume volume-0b26a175-a92f-4df7-b1be-6e8202814c8f (0b26a175-a92f-4df7-b1be-6e8202814c8f): created successfully Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f588d3e-a6fe-407c-b4ed-05d41a84d20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Flow 'volume_create_manager' (148cf47d-d470-4cfd-b98c-6ca132a90d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5a2fcdf9-853e-486a-96d6-4c9990557e91 tempest-ProjectReaderTests-338098337 None] Created volume successfully. Jul 11 19:08:05 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772" returned: 0 in 0.798s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b46386c-2479-4af8-9844-3068ce06be5e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:05 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f8a23933-fe9d-49d1-89db-614c2d2761d9" returned: 0 in 0.670s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-f8a23933-fe9d-49d1-89db-614c2d2761d9" released by "delete_volume" :: held 1.524s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:05 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 Jul 11 19:08:05 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Created reservations ['c0e44f8c-7b8f-4028-8267-7e1e3f08d7b6', '104f1c59-5583-4e27-8cee-7c60e8645ec3', 'f048d899-2250-4b21-83d3-6b2fd3869113', '3f109bfe-e1e6-4992-aed7-72a1e3c83a6d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:05 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:05 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Acquiring lock "cinder-0b26a175-a92f-4df7-b1be-6e8202814c8f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Lock "cinder-0b26a175-a92f-4df7-b1be-6e8202814c8f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Acquiring lock "cinder-quobyte-0b26a175-a92f-4df7-b1be-6e8202814c8f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Lock "cinder-quobyte-0b26a175-a92f-4df7-b1be-6e8202814c8f" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[041be7ed-b4af-430a-aa7b-e232251d9dc9]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:05 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f Jul 11 19:08:05 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:05 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626" returned: 0 in 0.806s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:06 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 Jul 11 19:08:06 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:06 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.688s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Deleted volume successfully. Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f49e4b2-c736-4cde-86d5-acf04dcc9b34 tempest-ProjectReaderTests-124290530 None] Lock "cinder-f8a23933-fe9d-49d1-89db-614c2d2761d9-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (6a97ecbb-8ef9-453d-b606-8910a957e674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3203a1bf-273a-4f51-b7c7-320a198e241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3203a1bf-273a-4f51-b7c7-320a198e241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1301629012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6686d79f-7ca5-48dd-b952-5cb71c62ff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:06Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bc3f32-0a26-451c-818e-7b515b847686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bc3f32-0a26-451c-818e-7b515b847686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f83c7b-064a-4a78-8ea4-469f1a8dafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f83c7b-064a-4a78-8ea4-469f1a8dafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6686d79f-7ca5-48dd-b952-5cb71c62ff66', 'volume_name': 'volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30721099-b2a9-4eae-bc39-e74a209150fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30721099-b2a9-4eae-bc39-e74a209150fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d796c7b8-3754-4053-a4a1-14caea0fe991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Volume 6686d79f-7ca5-48dd-b952-5cb71c62ff66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66', 'volume_size': 1} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1301629012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6686d79f-7ca5-48dd-b952-5cb71c62ff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:06Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Creating volume 6686d79f-7ca5-48dd-b952-5cb71c62ff66 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:08:06 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:06 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 1073741824 Jul 11 19:08:06 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:06 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f" returned: 0 in 0.912s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:06 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f Jul 11 19:08:06 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:06 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772" returned: 0 in 0.852s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:06 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772 Jul 11 19:08:06 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:07 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-0b26a175-a92f-4df7-b1be-6e8202814c8f" returned: 0 in 0.691s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:07 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Lock "cinder-quobyte-0b26a175-a92f-4df7-b1be-6e8202814c8f" released by "delete_volume" :: held 1.676s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 1073741824" returned: 0 in 0.905s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:07 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 Jul 11 19:08:07 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:07 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626.d9478289-bcdc-4b66-9df3-0356b7533772" returned: 0 in 0.684s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Created reservations ['cb38d4d8-fb14-4325-8ea4-80b8f340fd89', '6e933cde-823b-427b-9df5-7bbe620bb528', '59956e86-4cab-4863-8477-c0daefdfa18c', '8df9e707-e12b-4906-8cbf-f1a9d385a94f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-quobyte-d9478289-bcdc-4b66-9df3-0356b7533772" released by "_delete_snapshot" :: held 3.258s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-quobyte-dd7ef685-4953-42d6-8f8b-4a76fcba1626" released by "delete_snapshot" :: held 3.289s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Created reservations ['30c887b9-70b0-47a0-9220-325d2dae82bc', 'e1e017c0-e9a3-451a-880a-5a1f236685df', '26539661-7264-48ab-82fa-040e775886f2', '1fd29378-ba07-4fd0-8218-87ea6420c8c7'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:07 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:07 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Delete snapshot completed successfully. Jul 11 19:08:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b742ec11-3e90-466d-b6ed-0743865ce261 tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-d9478289-bcdc-4b66-9df3-0356b7533772-delete_snapshot" released by "delete_snapshot" :: held 3.462s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:08 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66" returned: 0 in 0.657s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d796c7b8-3754-4053-a4a1-14caea0fe991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5899176a-a835-4d96-aadd-b63516264783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Volume volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 (6686d79f-7ca5-48dd-b952-5cb71c62ff66): created successfully Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5899176a-a835-4d96-aadd-b63516264783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (6a97ecbb-8ef9-453d-b606-8910a957e674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ed470bf3-2e1a-41e8-bfce-568c1040fe70 tempest-ProjectReaderTests-124290530 None] Created volume successfully. Jul 11 19:08:08 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.681s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Deleted volume successfully. Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5747d5d9-752a-4d37-a554-e6e34e5c8d5b tempest-ProjectReaderTests-338098337 None] Lock "cinder-0b26a175-a92f-4df7-b1be-6e8202814c8f-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "cinder-dd7ef685-4953-42d6-8f8b-4a76fcba1626-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-dd7ef685-4953-42d6-8f8b-4a76fcba1626-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "cinder-quobyte-dd7ef685-4953-42d6-8f8b-4a76fcba1626" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-quobyte-dd7ef685-4953-42d6-8f8b-4a76fcba1626" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4216dc-e542-4e72-a83c-5185fd9df2b4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:08 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 Jul 11 19:08:08 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Creating offline snapshot a9008849-4e37-4869-b08d-8ac1c13783e2 of volume 6686d79f-7ca5-48dd-b952-5cb71c62ff66 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[80391e03-6dd7-425a-b31f-094c73af1d7f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:09 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 Jul 11 19:08:09 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:09 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626" returned: 0 in 0.875s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:09 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626 Jul 11 19:08:09 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:09 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66" returned: 0 in 0.882s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:09 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 1G Jul 11 19:08:09 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:10 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-dd7ef685-4953-42d6-8f8b-4a76fcba1626" returned: 0 in 0.677s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-quobyte-dd7ef685-4953-42d6-8f8b-4a76fcba1626" released by "delete_volume" :: held 1.635s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=135,cinder:INSERT=39,cinder:UPDATE=155,cinder:DELETE=16 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=119,cinder:INSERT=46,cinder:UPDATE=184,cinder:DELETE=14 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Created reservations ['b0b99446-9e40-433e-a582-bdc16ff5d776', 'a300bde8-57d9-455f-9c4a-324f188acf40', '91c75121-1fe1-4774-b78c-66a434dd8052', '67537196-85df-453e-a861-517f2f3a9171'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:10 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:10 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:10 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 1G" returned: 0 in 0.846s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:10 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 Jul 11 19:08:10 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "cinder-31db6052-f4d6-4b1d-80c3-d83b8cad474f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-31db6052-f4d6-4b1d-80c3-d83b8cad474f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "cinder-quobyte-31db6052-f4d6-4b1d-80c3-d83b8cad474f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-quobyte-31db6052-f4d6-4b1d-80c3-d83b8cad474f" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d61545-b9f9-4340-8875-960283ac0601]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:11 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f Jul 11 19:08:11 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:11 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Deleted volume successfully. Jul 11 19:08:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ee591739-17c2-492b-b985-fd99658df9de tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-dd7ef685-4953-42d6-8f8b-4a76fcba1626-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:11 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2" returned: 0 in 0.739s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:11 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 is being set with open permissions: ugo+rw Jul 11 19:08:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:11 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 Jul 11 19:08:11 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:11 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f" returned: 0 in 0.778s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:11 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f Jul 11 19:08:11 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:12 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2" returned: 0 in 0.650s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:12 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.info Jul 11 19:08:12 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:12 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-31db6052-f4d6-4b1d-80c3-d83b8cad474f" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-quobyte-31db6052-f4d6-4b1d-80c3-d83b8cad474f" released by "delete_volume" :: held 1.479s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Created reservations ['6ffde100-6d55-45d0-9f5d-64ad8e3368ba', '9ddf0bbd-9b40-442c-ae16-4b1a5980b662', '63d29298-df98-4c29-b654-873d286cec62', '616e11c4-ad11-4f82-a552-2ef66a6eb2fb'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:12 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:12 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:12 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.info" returned: 0 in 0.672s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:12 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.info is being set with open permissions: ugo+rw Jul 11 19:08:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:12 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.info Jul 11 19:08:12 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:13 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:13 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Deleted volume successfully. Jul 11 19:08:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5d3f7355-69bb-480c-a37b-d716eb3697ed tempest-CinderUnicodeTest-1563157689 None] Lock "cinder-31db6052-f4d6-4b1d-80c3-d83b8cad474f-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:13 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.info" returned: 0 in 0.755s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.652s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2c0f0f1-9947-4de8-834d-c28a79561254 tempest-ProjectReaderTests-124290530 None] Create snapshot completed successfully Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-a9008849-4e37-4869-b08d-8ac1c13783e2-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Lock "cinder-a9008849-4e37-4869-b08d-8ac1c13783e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-6686d79f-7ca5-48dd-b952-5cb71c62ff66" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-6686d79f-7ca5-48dd-b952-5cb71c62ff66" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-a9008849-4e37-4869-b08d-8ac1c13783e2" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-a9008849-4e37-4869-b08d-8ac1c13783e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Deleting offline snapshot a9008849-4e37-4869-b08d-8ac1c13783e2 of volume 6686d79f-7ca5-48dd-b952-5cb71c62ff66 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] snapshot_file for this snap is: volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e1756-c6f7-4165-92e0-a16e1768153e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:14 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 Jul 11 19:08:14 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:14 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2" returned: 0 in 0.798s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea16bb6f-15f0-40ab-91ff-d0efcb3b855e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:15 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 Jul 11 19:08:15 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:15 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:15 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:15 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66" returned: 0 in 0.766s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:15 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 Jul 11 19:08:15 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:15 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:08:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:08:16 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (2c33a69b-3bd0-4769-aaa2-6fae0fef4b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b049470f-db70-4c7b-b879-8786f014b33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2" returned: 0 in 0.770s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:16 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2 Jul 11 19:08:16 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b049470f-db70-4c7b-b879-8786f014b33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565320047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f670d3d1-a590-4a84-b2bb-cb829929b587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:16Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2fd19d-f577-4601-b431-461c2e754483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2fd19d-f577-4601-b431-461c2e754483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431ac137-99a9-403d-b217-1e7fdbf7da8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431ac137-99a9-403d-b217-1e7fdbf7da8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f670d3d1-a590-4a84-b2bb-cb829929b587', 'volume_name': 'volume-f670d3d1-a590-4a84-b2bb-cb829929b587', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49bf1db4-a7bc-407e-b97a-693875d407ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49bf1db4-a7bc-407e-b97a-693875d407ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0889c619-0071-409d-9038-0c4424870f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Volume f670d3d1-a590-4a84-b2bb-cb829929b587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f670d3d1-a590-4a84-b2bb-cb829929b587', 'volume_size': 1} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565320047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f670d3d1-a590-4a84-b2bb-cb829929b587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:16Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Creating volume f670d3d1-a590-4a84-b2bb-cb829929b587 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:08:16 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:08:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:16 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 1073741824 Jul 11 19:08:16 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:17 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66.a9008849-4e37-4869-b08d-8ac1c13783e2" returned: 0 in 0.671s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-a9008849-4e37-4869-b08d-8ac1c13783e2" released by "_delete_snapshot" :: held 3.129s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-6686d79f-7ca5-48dd-b952-5cb71c62ff66" released by "delete_snapshot" :: held 3.154s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:17 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Created reservations ['2f5471e6-4c14-44bb-807d-ab84ebc7d043', '435134e1-271c-40bd-bb59-fbce117cd7dd', 'b4630e51-e5b3-40f0-93ff-97a58e338a30', 'f5ac33f1-8586-40a9-be95-2979bf22784f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Delete snapshot completed successfully. Jul 11 19:08:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-37ad9f65-05cd-45ac-9ae7-bb79b6a8c56c tempest-ProjectReaderTests-124290530 None] Lock "cinder-a9008849-4e37-4869-b08d-8ac1c13783e2-delete_snapshot" released by "delete_snapshot" :: held 3.297s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:17 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 1073741824" returned: 0 in 0.844s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:17 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 Jul 11 19:08:17 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:18 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587" returned: 0 in 0.623s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0889c619-0071-409d-9038-0c4424870f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f670d3d1-a590-4a84-b2bb-cb829929b587', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824a73d5-17e5-4b61-aded-c3af4746b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Volume volume-f670d3d1-a590-4a84-b2bb-cb829929b587 (f670d3d1-a590-4a84-b2bb-cb829929b587): created successfully Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824a73d5-17e5-4b61-aded-c3af4746b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (2c33a69b-3bd0-4769-aaa2-6fae0fef4b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ce1798b1-6dc3-4a5c-9bc9-1d0b91b53c27 tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-6686d79f-7ca5-48dd-b952-5cb71c62ff66-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Lock "cinder-6686d79f-7ca5-48dd-b952-5cb71c62ff66-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-6686d79f-7ca5-48dd-b952-5cb71c62ff66" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-6686d79f-7ca5-48dd-b952-5cb71c62ff66" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c87a56-4c11-4e19-8727-d5897d39d9c8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:18 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 Jul 11 19:08:18 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Creating offline snapshot b8d960ba-4968-4244-ad45-8a7d747fe9c2 of volume f670d3d1-a590-4a84-b2bb-cb829929b587 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2778b727-7acc-47ad-b80f-b089bfa1ea59]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:18 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 Jul 11 19:08:18 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:19 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66" returned: 0 in 0.790s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:19 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66 Jul 11 19:08:19 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:19 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587" returned: 0 in 0.775s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:19 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 1G Jul 11 19:08:19 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:19 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-6686d79f-7ca5-48dd-b952-5cb71c62ff66" returned: 0 in 0.647s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-6686d79f-7ca5-48dd-b952-5cb71c62ff66" released by "delete_volume" :: held 1.492s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Created reservations ['2843a898-210d-4a83-9947-16f656f53de2', '18c32589-ca51-4562-9342-2e66e9ab3b8f', '795d25de-d609-47b1-adae-040012a0fe78', '4f283307-a604-428f-90e8-a1029465726d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:20 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:20 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:20 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 1G" returned: 0 in 0.791s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f670d3d1-a590-4a84-b2bb-cb829929b587 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:20 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f670d3d1-a590-4a84-b2bb-cb829929b587 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 Jul 11 19:08:20 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:20 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.721s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Deleted volume successfully. Jul 11 19:08:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1833a6f5-4565-44c0-9572-1f407ed45f73 tempest-ProjectReaderTests-124290530 None] Lock "cinder-6686d79f-7ca5-48dd-b952-5cb71c62ff66-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (ac5bbbef-6796-4f67-890e-b20e9e274dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248fe2c8-8ae9-4e3a-950a-47d569f6eddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248fe2c8-8ae9-4e3a-950a-47d569f6eddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145299565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea7f807-6014-491e-9d70-af5ef808b832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:21Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a0f9a1-240b-420e-ab97-a1328e3ee9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a0f9a1-240b-420e-ab97-a1328e3ee9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705aee94-f881-4e5d-b467-60e10219af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705aee94-f881-4e5d-b467-60e10219af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea7f807-6014-491e-9d70-af5ef808b832', 'volume_name': 'volume-8ea7f807-6014-491e-9d70-af5ef808b832', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d59fc7c-24ca-444b-8909-3f88f47f2601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d59fc7c-24ca-444b-8909-3f88f47f2601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7b43d5-ae13-4f40-b461-158bf5517102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Volume 8ea7f807-6014-491e-9d70-af5ef808b832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea7f807-6014-491e-9d70-af5ef808b832', 'volume_size': 1} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:21 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f670d3d1-a590-4a84-b2bb-cb829929b587 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2" returned: 0 in 0.719s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:21 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 is being set with open permissions: ugo+rw Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:21 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 Jul 11 19:08:21 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:21 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2" returned: 0 in 0.644s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:21 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.info Jul 11 19:08:21 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:22 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.info" returned: 0 in 0.646s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:22 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.info is being set with open permissions: ugo+rw Jul 11 19:08:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:22 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.info Jul 11 19:08:22 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:23 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.info" returned: 0 in 0.636s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.299s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145299565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea7f807-6014-491e-9d70-af5ef808b832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b7840241904bbbad2ac2a9369a9750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:21Z,use_quota=True,user_id='a1c97d1386874dd5a99095f42150c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Creating volume 8ea7f807-6014-491e-9d70-af5ef808b832 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:08:23 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:23 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 1073741824 Jul 11 19:08:23 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d0267614-f1a9-48dc-aceb-078d72f5bde9 tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:08:23 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 1073741824" returned: 0 in 0.801s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:24 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 Jul 11 19:08:24 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-b8d960ba-4968-4244-ad45-8a7d747fe9c2-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Lock "cinder-b8d960ba-4968-4244-ad45-8a7d747fe9c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-f670d3d1-a590-4a84-b2bb-cb829929b587" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-f670d3d1-a590-4a84-b2bb-cb829929b587" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-b8d960ba-4968-4244-ad45-8a7d747fe9c2" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-b8d960ba-4968-4244-ad45-8a7d747fe9c2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot b8d960ba-4968-4244-ad45-8a7d747fe9c2 of volume f670d3d1-a590-4a84-b2bb-cb829929b587 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f54620-f87d-439d-b113-135ff245d574]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:24 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 Jul 11 19:08:24 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:24 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832" returned: 0 in 0.675s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7b43d5-ae13-4f40-b461-158bf5517102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea7f807-6014-491e-9d70-af5ef808b832', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab6370f-c9db-40ff-a1ba-8306df34ba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Volume volume-8ea7f807-6014-491e-9d70-af5ef808b832 (8ea7f807-6014-491e-9d70-af5ef808b832): created successfully Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab6370f-c9db-40ff-a1ba-8306df34ba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Flow 'volume_create_manager' (ac5bbbef-6796-4f67-890e-b20e9e274dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-09643d24-f59d-4dce-92fe-1602eb18e497 tempest-ProjectReaderTests-124290530 None] Created volume successfully. Jul 11 19:08:24 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2" returned: 0 in 0.761s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f670d3d1-a590-4a84-b2bb-cb829929b587(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2093868-52f1-4f02-892a-22404c4a88fc]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:25 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 Jul 11 19:08:25 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Creating offline snapshot 02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 of volume 8ea7f807-6014-491e-9d70-af5ef808b832 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:08:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b237cd-1146-4717-aa62-ef16c0570d8f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:25 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 Jul 11 19:08:25 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:25 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587" returned: 0 in 0.790s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:25 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 Jul 11 19:08:25 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:26 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832" returned: 0 in 0.788s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:26 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 1G Jul 11 19:08:26 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:26 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2" returned: 0 in 0.767s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:26 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2 Jul 11 19:08:26 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:27 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 1G" returned: 0 in 0.792s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea7f807-6014-491e-9d70-af5ef808b832 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:27 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea7f807-6014-491e-9d70-af5ef808b832 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 Jul 11 19:08:27 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:27 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587.b8d960ba-4968-4244-ad45-8a7d747fe9c2" returned: 0 in 0.681s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-b8d960ba-4968-4244-ad45-8a7d747fe9c2" released by "_delete_snapshot" :: held 3.116s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-f670d3d1-a590-4a84-b2bb-cb829929b587" released by "delete_snapshot" :: held 3.138s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Created reservations ['b528560b-20ec-47da-bd06-bd5c66cd0ff4', '3b11aefc-172c-40f7-8fb7-46247caf5e18', 'a4801806-9064-4bac-ad44-2196f69b64f8', 'fbdb398d-4d30-4347-b4ee-73fbd9db9787'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e258d2b-19da-4ec5-bcff-63080a34f475 tempest-ProjectMemberTests-620667099 None] Lock "cinder-b8d960ba-4968-4244-ad45-8a7d747fe9c2-delete_snapshot" released by "delete_snapshot" :: held 3.273s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:27 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea7f807-6014-491e-9d70-af5ef808b832 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6" returned: 0 in 0.712s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:27 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 is being set with open permissions: ugo+rw Jul 11 19:08:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:27 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 Jul 11 19:08:27 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-f670d3d1-a590-4a84-b2bb-cb829929b587-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:28 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Lock "cinder-f670d3d1-a590-4a84-b2bb-cb829929b587-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6" returned: 0 in 0.641s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:28 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.info Jul 11 19:08:28 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-f670d3d1-a590-4a84-b2bb-cb829929b587" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-f670d3d1-a590-4a84-b2bb-cb829929b587" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cd6731-08b6-4cf2-94b4-f41a1f6ad7bd]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:28 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 Jul 11 19:08:28 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:29 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.info" returned: 0 in 0.641s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:29 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.info is being set with open permissions: ugo+rw Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:29 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.info Jul 11 19:08:29 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:29 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:29 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587 Jul 11 19:08:29 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:29 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.info" returned: 0 in 0.630s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.292s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b9b2305e-f1d5-4fd5-b419-6ee0abb6faa4 tempest-ProjectReaderTests-124290530 None] Create snapshot completed successfully Jul 11 19:08:29 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-f670d3d1-a590-4a84-b2bb-cb829929b587" returned: 0 in 0.658s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-f670d3d1-a590-4a84-b2bb-cb829929b587" released by "delete_volume" :: held 1.465s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:29 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Created reservations ['3154acf4-c0f8-40b3-87e0-3cdfd14a6a1e', 'd42c090b-7a94-4da4-8088-ce07cae94c94', 'e767449e-0a39-4b8e-b489-ccda72a045be', '23bd8dde-7440-4c50-b640-d287888288df'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:30 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:30 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Lock "cinder-02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-8ea7f807-6014-491e-9d70-af5ef808b832" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-8ea7f807-6014-491e-9d70-af5ef808b832" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:30 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.692s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Deleting offline snapshot 02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 of volume 8ea7f807-6014-491e-9d70-af5ef808b832 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] snapshot_file for this snap is: volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:08:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e61baa6-c15e-4b76-945c-20bf9b164c5c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b93dc712-b723-4f07-b9af-2bed877a9760 tempest-ProjectMemberTests-620667099 None] Lock "cinder-f670d3d1-a590-4a84-b2bb-cb829929b587-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:30 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 Jul 11 19:08:30 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (9fa9a977-a2c3-415b-a178-e17d98084df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2134b8b6-bb34-4d7c-8c55-3e1b1776540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2134b8b6-bb34-4d7c-8c55-3e1b1776540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-623249313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b39ef3-678a-4d73-977f-107c92831383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:31Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c96c1e2-5df8-4b28-90f9-68c7d374e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c96c1e2-5df8-4b28-90f9-68c7d374e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0181d661-78af-4c56-9b5a-70d5be2f9936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0181d661-78af-4c56-9b5a-70d5be2f9936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b39ef3-678a-4d73-977f-107c92831383', 'volume_name': 'volume-33b39ef3-678a-4d73-977f-107c92831383', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0a21ea-b898-4f36-8769-6980c20d552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0a21ea-b898-4f36-8769-6980c20d552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e27dd03-70a8-455e-b948-8e0eb7e7ac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Volume 33b39ef3-678a-4d73-977f-107c92831383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b39ef3-678a-4d73-977f-107c92831383', 'volume_size': 1} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-623249313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b39ef3-678a-4d73-977f-107c92831383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:31Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Creating volume 33b39ef3-678a-4d73-977f-107c92831383 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:08:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:31 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 1073741824 Jul 11 19:08:31 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:31 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6" returned: 0 in 0.782s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ea7f807-6014-491e-9d70-af5ef808b832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d999bbda-3ed0-4178-b991-06b02f142952]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:31 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 Jul 11 19:08:31 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:31 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 1073741824" returned: 0 in 0.851s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:32 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 Jul 11 19:08:32 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:32 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832" returned: 0 in 0.765s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:32 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 Jul 11 19:08:32 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:32 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383" returned: 0 in 0.649s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e27dd03-70a8-455e-b948-8e0eb7e7ac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b39ef3-678a-4d73-977f-107c92831383', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb02e3d8-fa77-4cd6-9baf-4a8c8b857830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Volume volume-33b39ef3-678a-4d73-977f-107c92831383 (33b39ef3-678a-4d73-977f-107c92831383): created successfully Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb02e3d8-fa77-4cd6-9baf-4a8c8b857830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (9fa9a977-a2c3-415b-a178-e17d98084df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d57ee1e2-8f79-483d-9b5f-0375b47df99a tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:08:33 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6" returned: 0 in 0.735s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:33 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6 Jul 11 19:08:33 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Creating offline snapshot 08dd7e08-92ed-467d-87ab-81403042100c of volume 33b39ef3-678a-4d73-977f-107c92831383 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b826e05-e032-44be-a032-18d445290a31]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:33 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 Jul 11 19:08:33 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:33 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832.02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6" returned: 0 in 0.655s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6" released by "_delete_snapshot" :: held 3.037s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-8ea7f807-6014-491e-9d70-af5ef808b832" released by "delete_snapshot" :: held 3.066s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Created reservations ['8b762f4c-8ff6-407a-b622-c8695115b086', '41480ca1-53a2-4d23-8504-c759892d0260', '22a77c52-4d38-45ac-9e2e-db8437b48417', '1d28638e-29fc-4b4a-a123-402cbfec5fbf'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Delete snapshot completed successfully. Jul 11 19:08:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-defc02a9-c038-4e86-8dd1-485abb14e67f tempest-ProjectReaderTests-124290530 None] Lock "cinder-02f75a1a-1cd0-4fb5-a01f-7b1d2b07b2c6-delete_snapshot" released by "delete_snapshot" :: held 3.210s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:34 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383" returned: 0 in 0.769s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:34 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c 1G Jul 11 19:08:34 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-8ea7f807-6014-491e-9d70-af5ef808b832-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:34 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c 1G" returned: 0 in 0.796s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b39ef3-678a-4d73-977f-107c92831383 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Lock "cinder-8ea7f807-6014-491e-9d70-af5ef808b832-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:34 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b39ef3-678a-4d73-977f-107c92831383 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c Jul 11 19:08:34 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Acquiring lock "cinder-quobyte-8ea7f807-6014-491e-9d70-af5ef808b832" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-8ea7f807-6014-491e-9d70-af5ef808b832" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99cf83c-c712-428d-8e7e-603e390aade8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:35 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 Jul 11 19:08:35 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:35 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b39ef3-678a-4d73-977f-107c92831383 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c" returned: 0 in 0.688s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:35 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c is being set with open permissions: ugo+rw Jul 11 19:08:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:35 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c Jul 11 19:08:35 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:35 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832" returned: 0 in 0.777s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:35 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832 Jul 11 19:08:35 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:36 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c" returned: 0 in 0.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:36 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.info Jul 11 19:08:36 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:36 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-8ea7f807-6014-491e-9d70-af5ef808b832" returned: 0 in 0.650s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Lock "cinder-quobyte-8ea7f807-6014-491e-9d70-af5ef808b832" released by "delete_volume" :: held 1.487s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Created reservations ['ae9d4ae6-e971-466b-a3b9-f075de491a75', '7ab171b3-b105-4c36-b4dc-ed622d37a4ee', 'd9bde50d-a141-4ec0-b331-f8065dac4d29', 'aa9c3a2c-067a-487b-96d9-8f77aa8631f4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:36 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:36 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:36 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.info" returned: 0 in 0.670s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:36 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.info is being set with open permissions: ugo+rw Jul 11 19:08:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:36 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.info Jul 11 19:08:36 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:37 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.654s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Deleted volume successfully. Jul 11 19:08:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f559228f-68b4-448b-be6e-936ba0fe6b01 tempest-ProjectReaderTests-124290530 None] Lock "cinder-8ea7f807-6014-491e-9d70-af5ef808b832-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:37 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.info" returned: 0 in 0.665s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.309s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0710d1f1-017a-48d9-8814-69bfd4d74d16 tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-08dd7e08-92ed-467d-87ab-81403042100c-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Lock "cinder-08dd7e08-92ed-467d-87ab-81403042100c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-33b39ef3-678a-4d73-977f-107c92831383" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-33b39ef3-678a-4d73-977f-107c92831383" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-08dd7e08-92ed-467d-87ab-81403042100c" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-08dd7e08-92ed-467d-87ab-81403042100c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot 08dd7e08-92ed-467d-87ab-81403042100c of volume 33b39ef3-678a-4d73-977f-107c92831383 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc7965a-5b69-4a09-8b40-8f113e2d9e81]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:38 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c Jul 11 19:08:38 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:39 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c" returned: 0 in 0.786s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b39ef3-678a-4d73-977f-107c92831383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:08:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e66017f-3d2c-4d28-a5ad-37ba389bbbd9]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:39 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 Jul 11 19:08:39 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:40 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383" returned: 0 in 0.779s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:40 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c Jul 11 19:08:40 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:40 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c" returned: 0 in 0.754s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:40 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c Jul 11 19:08:40 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:41 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383.08dd7e08-92ed-467d-87ab-81403042100c" returned: 0 in 0.640s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-08dd7e08-92ed-467d-87ab-81403042100c" released by "_delete_snapshot" :: held 3.060s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-33b39ef3-678a-4d73-977f-107c92831383" released by "delete_snapshot" :: held 3.083s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Created reservations ['275ca1ed-ad56-43bd-a13f-5c58e0d2a734', '694d14ef-2da8-4b95-b7de-ff0b55b8a39a', '7bfdcfd3-9cb6-4401-a1d5-a743198d20f8', 'b6cc1259-f25b-45ce-bd0e-83f3e136d4d6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:08:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-15fee415-f12d-476d-8053-69561cb48624 tempest-ProjectMemberTests-620667099 None] Lock "cinder-08dd7e08-92ed-467d-87ab-81403042100c-delete_snapshot" released by "delete_snapshot" :: held 3.227s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-33b39ef3-678a-4d73-977f-107c92831383-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Lock "cinder-33b39ef3-678a-4d73-977f-107c92831383-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-33b39ef3-678a-4d73-977f-107c92831383" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-33b39ef3-678a-4d73-977f-107c92831383" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fee4dc7-3cfc-4b7a-9f03-c2c3de026ee4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:42 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 Jul 11 19:08:42 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:43 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383" returned: 0 in 0.742s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:43 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383 Jul 11 19:08:43 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:44 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-33b39ef3-678a-4d73-977f-107c92831383" returned: 0 in 0.693s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-33b39ef3-678a-4d73-977f-107c92831383" released by "delete_volume" :: held 1.502s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Created reservations ['a4ec455a-b421-4c3f-ada3-7d0c180b24d7', '805599dc-43a6-448e-b663-8884654817d0', 'cec9480b-58d2-4cb1-836f-3d4584a506aa', 'c7fee935-7dc3-46aa-bc8a-21397d5ab687'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:44 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:44 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:45 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.708s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14c8b41d-72dd-4c92-a5bb-acc7a2481ce4 tempest-ProjectMemberTests-620667099 None] Lock "cinder-33b39ef3-678a-4d73-977f-107c92831383-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (b2b58f69-3db5-4f85-8aef-0c340528d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aad07f6-9bb8-45a5-86a0-f6b0c1375f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aad07f6-9bb8-45a5-86a0-f6b0c1375f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813541730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16469365-22df-4964-8583-d0d656106133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:46Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d29a9f-4177-41bb-bea5-b930eef491e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d29a9f-4177-41bb-bea5-b930eef491e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c29460-3a89-4bfa-9587-4948be8fa761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c29460-3a89-4bfa-9587-4948be8fa761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16469365-22df-4964-8583-d0d656106133', 'volume_name': 'volume-16469365-22df-4964-8583-d0d656106133', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bdf522-d470-4c68-919d-7247f245feac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bdf522-d470-4c68-919d-7247f245feac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18142881-5227-4828-8264-53baf66c2c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Volume 16469365-22df-4964-8583-d0d656106133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16469365-22df-4964-8583-d0d656106133', 'volume_size': 1} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813541730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16469365-22df-4964-8583-d0d656106133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:08:46Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Creating volume 16469365-22df-4964-8583-d0d656106133 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:08:45 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:08:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:45 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 1073741824 Jul 11 19:08:45 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:46 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 1073741824" returned: 0 in 0.853s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:46 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 Jul 11 19:08:46 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:47 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133" returned: 0 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18142881-5227-4828-8264-53baf66c2c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16469365-22df-4964-8583-d0d656106133', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c044851c-1562-4bab-a6ff-1d78efaf80f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:08:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Volume volume-16469365-22df-4964-8583-d0d656106133 (16469365-22df-4964-8583-d0d656106133): created successfully Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c044851c-1562-4bab-a6ff-1d78efaf80f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (b2b58f69-3db5-4f85-8aef-0c340528d54b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:08:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-da3f70e8-5023-46fc-8d4e-18b46ffdc7c7 tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Creating offline snapshot acfb597c-e2fe-449e-99ca-e04f890de59c of volume 16469365-22df-4964-8583-d0d656106133 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6a9e17-10a5-4593-90ba-57188b793132]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:47 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 Jul 11 19:08:47 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:48 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133" returned: 0 in 0.793s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:48 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c 1G Jul 11 19:08:48 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:49 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c 1G" returned: 0 in 0.854s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16469365-22df-4964-8583-d0d656106133 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:49 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16469365-22df-4964-8583-d0d656106133 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c Jul 11 19:08:49 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:50 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16469365-22df-4964-8583-d0d656106133 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c" returned: 0 in 0.726s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:50 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c is being set with open permissions: ugo+rw Jul 11 19:08:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:50 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c Jul 11 19:08:50 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:50 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c" returned: 0 in 0.667s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:50 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.info Jul 11 19:08:50 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:51 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.info" returned: 0 in 0.663s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:51 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.info is being set with open permissions: ugo+rw Jul 11 19:08:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:51 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.info Jul 11 19:08:51 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:52 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.info" returned: 0 in 0.654s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.468s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4224ce3e-bdec-4955-a0da-41741407aee7 tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-acfb597c-e2fe-449e-99ca-e04f890de59c-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Lock "cinder-acfb597c-e2fe-449e-99ca-e04f890de59c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-16469365-22df-4964-8583-d0d656106133" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-16469365-22df-4964-8583-d0d656106133" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-acfb597c-e2fe-449e-99ca-e04f890de59c" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-acfb597c-e2fe-449e-99ca-e04f890de59c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot acfb597c-e2fe-449e-99ca-e04f890de59c of volume 16469365-22df-4964-8583-d0d656106133 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[543c1b29-448c-4371-8605-4000a2c54407]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:53 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c Jul 11 19:08:53 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:53 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c" returned: 0 in 0.783s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16469365-22df-4964-8583-d0d656106133(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc290b-32f9-4488-b793-925f9365b7c2]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:54 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 Jul 11 19:08:54 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:54 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133" returned: 0 in 0.815s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:54 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c Jul 11 19:08:54 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:55 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c" returned: 0 in 0.818s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:55 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c Jul 11 19:08:55 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:56 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133.acfb597c-e2fe-449e-99ca-e04f890de59c" returned: 0 in 0.665s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-acfb597c-e2fe-449e-99ca-e04f890de59c" released by "_delete_snapshot" :: held 3.183s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-16469365-22df-4964-8583-d0d656106133" released by "delete_snapshot" :: held 3.215s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:56 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Created reservations ['f41eb271-9791-4e70-b317-edd40d18212f', 'ed5651c3-15ae-4475-a219-eec8664385f2', 'c479950c-2593-4c36-abcb-ffad1951fd93', '7ea6e338-7b45-4f51-b991-3a947f72e875'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:08:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f35f0c1-91df-45a1-b576-e9d18bb5e9ff tempest-ProjectMemberTests-620667099 None] Lock "cinder-acfb597c-e2fe-449e-99ca-e04f890de59c-delete_snapshot" released by "delete_snapshot" :: held 3.369s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-16469365-22df-4964-8583-d0d656106133-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Lock "cinder-16469365-22df-4964-8583-d0d656106133-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-16469365-22df-4964-8583-d0d656106133" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:08:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-16469365-22df-4964-8583-d0d656106133" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:08:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2293cad9-e37b-4cde-a7f8-287cb9853d2e]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:08:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:57 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 Jul 11 19:08:57 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:58 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133" returned: 0 in 0.776s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:58 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133 Jul 11 19:08:58 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:58 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-16469365-22df-4964-8583-d0d656106133" returned: 0 in 0.671s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-16469365-22df-4964-8583-d0d656106133" released by "delete_volume" :: held 1.520s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Created reservations ['9f1f1ccd-0ae8-425f-a3f8-49c44401c322', '095ebb9d-c380-43b5-9e61-7c2aaf16bb18', 'caa46194-e683-4c11-86d3-8c77d0720157', '7d4f20c2-aee4-4db1-8412-85e2492c0af4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:08:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:08:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:08:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:08:59 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:08:59 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:08:59 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 11 19:08:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.756s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:08:59 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:08:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:08:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-57403035-ed02-4589-b39c-cb53f9bfd987 tempest-ProjectMemberTests-620667099 None] Lock "cinder-16469365-22df-4964-8583-d0d656106133-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (a61c30cb-b4c9-415b-bf8b-ddc53a0bf71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91c5cc9-6b98-45e9-9392-85ffbabbe645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91c5cc9-6b98-45e9-9392-85ffbabbe645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006665027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c808867-1397-44fd-945b-f3d865c6cbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:00Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e025316-4589-47a8-80be-4741dcc1f33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e025316-4589-47a8-80be-4741dcc1f33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2287a1d0-d94c-4c28-808e-ad2e45e3111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2287a1d0-d94c-4c28-808e-ad2e45e3111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c808867-1397-44fd-945b-f3d865c6cbff', 'volume_name': 'volume-9c808867-1397-44fd-945b-f3d865c6cbff', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7aedf66-2a6d-4f68-864d-96aadb64e062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7aedf66-2a6d-4f68-864d-96aadb64e062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6d5b7b-e719-4529-8230-5613e4472de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Volume 9c808867-1397-44fd-945b-f3d865c6cbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c808867-1397-44fd-945b-f3d865c6cbff', 'volume_size': 1} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006665027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c808867-1397-44fd-945b-f3d865c6cbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:00Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Creating volume 9c808867-1397-44fd-945b-f3d865c6cbff {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:09:00 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:09:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:00 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff 1073741824 Jul 11 19:09:00 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:01 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff 1073741824" returned: 0 in 0.877s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:01 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff Jul 11 19:09:01 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:01 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff" returned: 0 in 0.701s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6d5b7b-e719-4529-8230-5613e4472de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c808867-1397-44fd-945b-f3d865c6cbff', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902069aa-2750-4ede-9bdf-467f91e624b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Volume volume-9c808867-1397-44fd-945b-f3d865c6cbff (9c808867-1397-44fd-945b-f3d865c6cbff): created successfully Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902069aa-2750-4ede-9bdf-467f91e624b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (a61c30cb-b4c9-415b-bf8b-ddc53a0bf71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1b0b5ba1-905f-406e-8dbc-58e5b265e661 tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:09:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Creating offline snapshot eafda255-bce1-4b86-8c0e-9c7a74675cc9 of volume 9c808867-1397-44fd-945b-f3d865c6cbff {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:09:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a9edc5-43d9-4fd8-ae30-31ae0735f8d4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:02 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff Jul 11 19:09:02 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:03 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff" returned: 0 in 0.786s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:03 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 1G Jul 11 19:09:03 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:04 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 1G" returned: 0 in 0.833s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c808867-1397-44fd-945b-f3d865c6cbff -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:04 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c808867-1397-44fd-945b-f3d865c6cbff -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 Jul 11 19:09:04 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:04 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c808867-1397-44fd-945b-f3d865c6cbff -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9" returned: 0 in 0.691s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:04 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 is being set with open permissions: ugo+rw Jul 11 19:09:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:04 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 Jul 11 19:09:04 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:05 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:05 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.info Jul 11 19:09:05 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:06 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.info" returned: 0 in 0.687s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:06 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.info is being set with open permissions: ugo+rw Jul 11 19:09:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:06 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.info Jul 11 19:09:06 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:06 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.info" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.551s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5344d0cb-89c0-4817-a433-c201e8fe2433 tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-eafda255-bce1-4b86-8c0e-9c7a74675cc9-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Lock "cinder-eafda255-bce1-4b86-8c0e-9c7a74675cc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-9c808867-1397-44fd-945b-f3d865c6cbff" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9c808867-1397-44fd-945b-f3d865c6cbff" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-eafda255-bce1-4b86-8c0e-9c7a74675cc9" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-eafda255-bce1-4b86-8c0e-9c7a74675cc9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot eafda255-bce1-4b86-8c0e-9c7a74675cc9 of volume 9c808867-1397-44fd-945b-f3d865c6cbff {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[42596323-4d26-44bb-91a9-5ff20e615772]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:07 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 Jul 11 19:09:07 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:08 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9" returned: 0 in 0.829s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c808867-1397-44fd-945b-f3d865c6cbff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:09:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad4f6db-9eb6-4c59-9440-b4db3d531b92]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:08 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff Jul 11 19:09:08 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:09 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff" returned: 0 in 0.860s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:09 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 Jul 11 19:09:09 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Flow 'volume_create_manager' (f73cd3db-ff0d-46ca-b0ac-5ee909b9a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc5a600-cf24-423a-aab5-8697d2379b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc5a600-cf24-423a-aab5-8697d2379b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1859205764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb770926-0081-4ef2-ab08-d6b3a05685c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5259161158084a3f9b180d7b8fa23140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:09Z,use_quota=True,user_id='87f29f7b864946458b953ed9f1567472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e024af-cfb7-4d5b-82a1-e542b5dbc16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e024af-cfb7-4d5b-82a1-e542b5dbc16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec38a29-88e8-4a4d-a11f-b22cc4a05534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec38a29-88e8-4a4d-a11f-b22cc4a05534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb770926-0081-4ef2-ab08-d6b3a05685c6', 'volume_name': 'volume-bb770926-0081-4ef2-ab08-d6b3a05685c6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9d68f0-77f9-4a6f-8c02-5d48e9a61975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9d68f0-77f9-4a6f-8c02-5d48e9a61975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8092cb8e-920b-412b-abba-8884c4031152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Volume bb770926-0081-4ef2-ab08-d6b3a05685c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb770926-0081-4ef2-ab08-d6b3a05685c6', 'volume_size': 1} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1859205764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb770926-0081-4ef2-ab08-d6b3a05685c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5259161158084a3f9b180d7b8fa23140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:09Z,use_quota=True,user_id='87f29f7b864946458b953ed9f1567472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Creating volume bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:09:09 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:09:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:09 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 1073741824 Jul 11 19:09:09 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:10 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9" returned: 0 in 0.760s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:10 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9 Jul 11 19:09:10 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:10 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 1073741824" returned: 0 in 0.871s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:INSERT=30,cinder:UPDATE=106,cinder:SELECT=83,cinder:DELETE=11 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=85,cinder:INSERT=29,cinder:UPDATE=109,cinder:DELETE=7 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:10 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 Jul 11 19:09:10 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:10 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff.eafda255-bce1-4b86-8c0e-9c7a74675cc9" returned: 0 in 0.702s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-eafda255-bce1-4b86-8c0e-9c7a74675cc9" released by "_delete_snapshot" :: held 3.270s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9c808867-1397-44fd-945b-f3d865c6cbff" released by "delete_snapshot" :: held 3.307s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Created reservations ['4b1c7be8-50b0-4aec-add0-ece915449550', '4e48fa5b-67f8-477b-a8b0-9d04d2dccbec', 'fcbb07b8-99fe-46eb-82d3-db8918f9b489', 'bf8954fe-e598-4a4e-97eb-f63c4c010f55'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed33ec6f-3c3e-4e90-a27e-07b9c00094f9 tempest-ProjectMemberTests-620667099 None] Lock "cinder-eafda255-bce1-4b86-8c0e-9c7a74675cc9-delete_snapshot" released by "delete_snapshot" :: held 3.462s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:11 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6" returned: 0 in 0.697s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8092cb8e-920b-412b-abba-8884c4031152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb770926-0081-4ef2-ab08-d6b3a05685c6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e429a6-d34d-4b6f-95b0-5a2c3d013e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Volume volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 (bb770926-0081-4ef2-ab08-d6b3a05685c6): created successfully Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e429a6-d34d-4b6f-95b0-5a2c3d013e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Flow 'volume_create_manager' (f73cd3db-ff0d-46ca-b0ac-5ee909b9a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9d494bf3-8001-4b7b-ac32-713ff785301e tempest-SnapshotDependencyTests-1843331328 None] Created volume successfully. Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Creating offline snapshot c942913f-312d-4451-815d-571d14bc81c8 of volume bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd21ba5e-9153-4f27-a67e-31862d727056]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-9c808867-1397-44fd-945b-f3d865c6cbff-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Lock "cinder-9c808867-1397-44fd-945b-f3d865c6cbff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:11 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 Jul 11 19:09:11 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-9c808867-1397-44fd-945b-f3d865c6cbff" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9c808867-1397-44fd-945b-f3d865c6cbff" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b22bd8-aed6-4006-8f34-346000b80b58]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:12 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff Jul 11 19:09:12 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:12 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6" returned: 0 in 0.787s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:12 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 1G Jul 11 19:09:12 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:12 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff" returned: 0 in 0.780s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:12 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff Jul 11 19:09:12 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:13 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 1G" returned: 0 in 0.864s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:13 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 Jul 11 19:09:13 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:13 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9c808867-1397-44fd-945b-f3d865c6cbff" returned: 0 in 0.684s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9c808867-1397-44fd-945b-f3d865c6cbff" released by "delete_volume" :: held 1.522s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Created reservations ['37fecdad-0a96-4811-b9e2-1cc2ba8d41b8', '3154da67-cd4c-4ad2-8df9-2efb9362370e', 'e1bd22ba-488c-410b-9163-f8c2552b3bea', 'aad3879d-3fb0-4780-b921-6deec247614f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:13 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:09:13 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:14 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8" returned: 0 in 0.723s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:14 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 is being set with open permissions: ugo+rw Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:14 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 Jul 11 19:09:14 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:14 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.653s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:09:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9baa431a-669a-4b27-9b7c-c5f58b9076b6 tempest-ProjectMemberTests-620667099 None] Lock "cinder-9c808867-1397-44fd-945b-f3d865c6cbff-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (4434fddf-4135-41f9-902b-7376b5e2b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff23f4f-28f6-4214-9b54-2294a89a12a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff23f4f-28f6-4214-9b54-2294a89a12a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1931517628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdf8067-4978-422b-9eb3-5d3094301e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:14Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532ad4bc-c3d6-423d-893a-f0a8aa49b5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532ad4bc-c3d6-423d-893a-f0a8aa49b5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9856af4-f49f-4824-93f5-3837d62819ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9856af4-f49f-4824-93f5-3837d62819ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efdf8067-4978-422b-9eb3-5d3094301e2e', 'volume_name': 'volume-efdf8067-4978-422b-9eb3-5d3094301e2e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de458700-0f3b-4833-9a21-1b9fa6bfd923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de458700-0f3b-4833-9a21-1b9fa6bfd923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e977f4-22e3-4399-8af8-53594d0b50a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Volume efdf8067-4978-422b-9eb3-5d3094301e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efdf8067-4978-422b-9eb3-5d3094301e2e', 'volume_size': 1} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:14 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8" returned: 0 in 0.652s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:14 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.info Jul 11 19:09:14 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:15 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:09:15 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:15 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.info" returned: 0 in 0.661s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:15 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.info is being set with open permissions: ugo+rw Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:15 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.info Jul 11 19:09:15 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:15 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.653s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:09:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:09:16 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.info" returned: 0 in 0.637s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.405s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1931517628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdf8067-4978-422b-9eb3-5d3094301e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:14Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Creating volume efdf8067-4978-422b-9eb3-5d3094301e2e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:09:16 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:16 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e 1073741824 Jul 11 19:09:16 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-821c9dd1-e6c5-48a2-b82b-549127a533f0 tempest-SnapshotDependencyTests-1843331328 None] Create snapshot completed successfully Jul 11 19:09:16 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e 1073741824" returned: 0 in 0.812s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:17 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e Jul 11 19:09:17 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Flow 'volume_create_manager' (3d5565a1-1e77-454a-92c6-93191f009f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210a1653-abe8-4232-8ae3-3e97af27b638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210a1653-abe8-4232-8ae3-3e97af27b638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57753294-2a15-4576-84fd-127fab232628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5259161158084a3f9b180d7b8fa23140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c942913f-312d-4451-815d-571d14bc81c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:17Z,use_quota=True,user_id='87f29f7b864946458b953ed9f1567472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a835da9-7501-42b2-8b0d-3968898f4d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a835da9-7501-42b2-8b0d-3968898f4d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fd4228-2314-4b9d-b38f-a595d26974ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fd4228-2314-4b9d-b38f-a595d26974ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57753294-2a15-4576-84fd-127fab232628', 'volume_name': 'volume-57753294-2a15-4576-84fd-127fab232628', 'volume_size': 1, 'snapshot_id': 'c942913f-312d-4451-815d-571d14bc81c8'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3baa744-7df1-46ba-80ec-042da2b0a9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3baa744-7df1-46ba-80ec-042da2b0a9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2ef48b-e9e3-4428-b57f-b9e64c0279c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Volume 57753294-2a15-4576-84fd-127fab232628: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57753294-2a15-4576-84fd-127fab232628', 'volume_size': 1, 'snapshot_id': 'c942913f-312d-4451-815d-571d14bc81c8'} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:17 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e" returned: 0 in 0.690s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.089s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-quobyte-c942913f-312d-4451-815d-571d14bc81c8-57753294-2a15-4576-84fd-127fab232628" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e977f4-22e3-4399-8af8-53594d0b50a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efdf8067-4978-422b-9eb3-5d3094301e2e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84aad25-7e3d-4881-99df-ab797e4cf80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-c942913f-312d-4451-815d-571d14bc81c8-57753294-2a15-4576-84fd-127fab232628" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Creating volume 57753294-2a15-4576-84fd-127fab232628 from snapshot c942913f-312d-4451-815d-571d14bc81c8 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-quobyte-57753294-2a15-4576-84fd-127fab232628" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-57753294-2a15-4576-84fd-127fab232628" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] snapshot: c942913f-312d-4451-815d-571d14bc81c8, volume: 57753294-2a15-4576-84fd-127fab232628, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 19:09:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Volume volume-efdf8067-4978-422b-9eb3-5d3094301e2e (efdf8067-4978-422b-9eb3-5d3094301e2e): created successfully Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84aad25-7e3d-4881-99df-ab797e4cf80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (4434fddf-4135-41f9-902b-7376b5e2b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-93bcb84d-5d86-4745-8659-73d571f4e0a3 tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e72ae4-8ea3-4e98-9fa4-4d59f61a4094]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:17 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 Jul 11 19:09:17 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:18 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8" returned: 0 in 0.755s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb770926-0081-4ef2-ab08-d6b3a05685c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:09:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 19:09:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 19:09:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f37dc9-0cd5-4a41-81fa-13f095bf6038]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:18 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 Jul 11 19:09:18 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:19 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6" returned: 0 in 0.762s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:19 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Path /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 19:09:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:19 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 Jul 11 19:09:19 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:23 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628" returned: 0 in 4.373s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[736aeaaa-9714-470a-adaa-c942c6aab584]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:23 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 Jul 11 19:09:23 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:24 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6" returned: 0 in 0.912s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:24 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Image conversion details: src /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6, size 1024.00 MB, duration 4.37 sec, destination /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:09:24 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Converted 1024.00 MB image at 234.10 MB/s Jul 11 19:09:24 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 is being set with open permissions: ugo+rw Jul 11 19:09:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:24 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 Jul 11 19:09:24 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:25 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628" returned: 0 in 0.637s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-57753294-2a15-4576-84fd-127fab232628" released by "_copy_volume_from_snapshot" :: held 7.542s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-c942913f-312d-4451-815d-571d14bc81c8-57753294-2a15-4576-84fd-127fab232628" released by "_create_volume_from_snapshot" :: held 7.574s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.603s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.403s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Creating offline snapshot 85eee151-402d-43fd-a6bf-65723d0211bf of volume efdf8067-4978-422b-9eb3-5d3094301e2e {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2ef48b-e9e3-4428-b57f-b9e64c0279c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57753294-2a15-4576-84fd-127fab232628', 'volume_size': 1, 'snapshot_id': 'c942913f-312d-4451-815d-571d14bc81c8'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b51b12-edbc-43c9-9069-8b7b8b489e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7380e6-a31b-4e35-af93-264832e680ce]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Volume volume-57753294-2a15-4576-84fd-127fab232628 (57753294-2a15-4576-84fd-127fab232628): created successfully Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b51b12-edbc-43c9-9069-8b7b8b489e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Flow 'volume_create_manager' (3d5565a1-1e77-454a-92c6-93191f009f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-666054fc-6427-4c96-bc46-b7552792d0d3 tempest-SnapshotDependencyTests-1843331328 None] Created volume successfully. Jul 11 19:09:25 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e Jul 11 19:09:25 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:26 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e" returned: 0 in 0.732s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:26 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf 1G Jul 11 19:09:26 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-c942913f-312d-4451-815d-571d14bc81c8-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-c942913f-312d-4451-815d-571d14bc81c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-quobyte-bb770926-0081-4ef2-ab08-d6b3a05685c6" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-bb770926-0081-4ef2-ab08-d6b3a05685c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-quobyte-c942913f-312d-4451-815d-571d14bc81c8" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-c942913f-312d-4451-815d-571d14bc81c8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Deleting offline snapshot c942913f-312d-4451-815d-571d14bc81c8 of volume bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] snapshot_file for this snap is: volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a18911d-3f41-4aef-be14-ea19e7d9632b]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:26 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 Jul 11 19:09:26 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:26 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf 1G" returned: 0 in 0.785s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efdf8067-4978-422b-9eb3-5d3094301e2e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:26 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efdf8067-4978-422b-9eb3-5d3094301e2e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf Jul 11 19:09:26 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:27 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8" returned: 0 in 0.772s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb770926-0081-4ef2-ab08-d6b3a05685c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:09:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ea9941-bde2-4106-b2fb-2eec9fa6c786]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:27 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 Jul 11 19:09:27 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:27 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efdf8067-4978-422b-9eb3-5d3094301e2e -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf" returned: 0 in 0.670s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:27 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf is being set with open permissions: ugo+rw Jul 11 19:09:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:27 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf Jul 11 19:09:27 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:27 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6" returned: 0 in 0.759s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:27 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 Jul 11 19:09:27 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:28 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf" returned: 0 in 0.653s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:28 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.info Jul 11 19:09:28 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:28 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8" returned: 0 in 0.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:28 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8 Jul 11 19:09:28 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:28 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.info" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:28 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.info is being set with open permissions: ugo+rw Jul 11 19:09:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:28 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.info Jul 11 19:09:28 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:29 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6.c942913f-312d-4451-815d-571d14bc81c8" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-c942913f-312d-4451-815d-571d14bc81c8" released by "_delete_snapshot" :: held 2.964s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-bb770926-0081-4ef2-ab08-d6b3a05685c6" released by "delete_snapshot" :: held 2.993s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Created reservations ['9af0232d-1adc-4de7-8aea-6fdd97a0a913', '48c2e7bc-fefe-4664-8c21-3f22c1a83481', '1033286e-d95c-461d-aa13-2a585e1c2333', '223b742b-5f2c-46c9-8f7e-11dcb4041054'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Delete snapshot completed successfully. Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e686d11-bab6-4468-a2b4-0a79ac7007f2 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-c942913f-312d-4451-815d-571d14bc81c8-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-bb770926-0081-4ef2-ab08-d6b3a05685c6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-bb770926-0081-4ef2-ab08-d6b3a05685c6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-quobyte-bb770926-0081-4ef2-ab08-d6b3a05685c6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-bb770926-0081-4ef2-ab08-d6b3a05685c6" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7d7875-fc6d-4d5f-aab2-0613f2c43edb]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:29 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.info" returned: 0 in 0.649s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.224s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-799c8626-f6dc-4509-9028-d1ddf48fed51 tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:09:29 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 Jul 11 19:09:29 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:30 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6" returned: 0 in 0.745s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:30 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6 Jul 11 19:09:30 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-85eee151-402d-43fd-a6bf-65723d0211bf-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Lock "cinder-85eee151-402d-43fd-a6bf-65723d0211bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-efdf8067-4978-422b-9eb3-5d3094301e2e" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-efdf8067-4978-422b-9eb3-5d3094301e2e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-85eee151-402d-43fd-a6bf-65723d0211bf" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-85eee151-402d-43fd-a6bf-65723d0211bf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot 85eee151-402d-43fd-a6bf-65723d0211bf of volume efdf8067-4978-422b-9eb3-5d3094301e2e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d04d22-eff5-400a-ad39-568a812b7525]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:30 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf Jul 11 19:09:30 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:30 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-bb770926-0081-4ef2-ab08-d6b3a05685c6" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-bb770926-0081-4ef2-ab08-d6b3a05685c6" released by "delete_volume" :: held 1.446s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:30 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Created reservations ['4b02d760-3f5e-4194-bb9f-4e3969b31638', '9550af79-b531-422f-8a62-eb261ec2060f', '67801901-1152-4798-9265-5813f0395991', '5194c32d-1930-4f4e-9ce3-38dd599d4ad2'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:31 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:09:31 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:31 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf" returned: 0 in 0.775s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efdf8067-4978-422b-9eb3-5d3094301e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[09819aed-db8b-44df-9f56-1b89151eab88]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:31 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e Jul 11 19:09:31 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-57753294-2a15-4576-84fd-127fab232628-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-57753294-2a15-4576-84fd-127fab232628-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "cinder-quobyte-57753294-2a15-4576-84fd-127fab232628" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:31 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.691s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:09:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Deleted volume successfully. Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-57753294-2a15-4576-84fd-127fab232628" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b02e3463-d39c-4446-8a7c-6d374cc1f8e6 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-bb770926-0081-4ef2-ab08-d6b3a05685c6-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e181ce-78e6-4463-97e5-a5feaddb9920]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:31 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 Jul 11 19:09:31 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:32 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e" returned: 0 in 0.808s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:32 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf Jul 11 19:09:32 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:32 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628" returned: 0 in 0.772s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:32 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628 Jul 11 19:09:32 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:32 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf" returned: 0 in 0.759s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:32 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf Jul 11 19:09:32 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:33 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-57753294-2a15-4576-84fd-127fab232628" returned: 0 in 0.680s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-quobyte-57753294-2a15-4576-84fd-127fab232628" released by "delete_volume" :: held 1.499s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Created reservations ['5682a17b-f786-4f7d-8286-f7e74924fd20', 'ae94a4f5-3eda-4357-b7e2-748f16e1c389', '2dda0c74-bd31-49c6-a11f-5a0189a75712', '9e25b0d5-148c-4bae-91af-46649bcd6637'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:33 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:09:33 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:33 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e.85eee151-402d-43fd-a6bf-65723d0211bf" returned: 0 in 0.688s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-85eee151-402d-43fd-a6bf-65723d0211bf" released by "_delete_snapshot" :: held 3.126s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-efdf8067-4978-422b-9eb3-5d3094301e2e" released by "delete_snapshot" :: held 3.148s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Created reservations ['3d01709d-e5d8-4ae9-ab43-590038d410c3', 'a89bd62f-10bf-4f05-a6f2-48fb3abdb527', '296fc72d-3818-4b96-b3d2-af24340bad08', 'b3a90473-2478-4fd5-85f8-3bb88f42f448'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:09:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-74a88d04-760e-4568-b234-65f59f84bf88 tempest-ProjectMemberTests-620667099 None] Lock "cinder-85eee151-402d-43fd-a6bf-65723d0211bf-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:34 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.662s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:09:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Deleted volume successfully. Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d26c2ac2-ef52-424b-b5bf-d1d0074af644 tempest-SnapshotDependencyTests-1843331328 None] Lock "cinder-57753294-2a15-4576-84fd-127fab232628-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-efdf8067-4978-422b-9eb3-5d3094301e2e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Lock "cinder-efdf8067-4978-422b-9eb3-5d3094301e2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-efdf8067-4978-422b-9eb3-5d3094301e2e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-efdf8067-4978-422b-9eb3-5d3094301e2e" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b74e9-0969-4dad-90ba-adeb2d313ce8]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:34 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e Jul 11 19:09:34 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:35 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e" returned: 0 in 0.809s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:35 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e Jul 11 19:09:35 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:36 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-efdf8067-4978-422b-9eb3-5d3094301e2e" returned: 0 in 0.632s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-efdf8067-4978-422b-9eb3-5d3094301e2e" released by "delete_volume" :: held 1.497s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Created reservations ['6a109661-7f2b-4da9-9eed-0e0aacf0cada', 'c977360a-caae-4dfb-a7b2-44a35e225455', '9b21fb47-5eb7-4076-80c5-95539de3a12c', '663c0c57-3025-45ea-975c-94ff482374ac'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:36 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:09:36 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:37 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.794s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:09:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b98507a3-8ab9-49ea-937c-7de1671228a0 tempest-ProjectMemberTests-620667099 None] Lock "cinder-efdf8067-4978-422b-9eb3-5d3094301e2e-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (e42d263b-179e-45c5-9846-0b1751d2052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8855037-3e2e-4e88-9e26-6ef708771a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8855037-3e2e-4e88-9e26-6ef708771a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-124434567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989ffefa-66a8-40ba-a8e2-15ffedc9059b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:37Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8632652-edc8-4a38-97d5-daa0d6617efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8632652-edc8-4a38-97d5-daa0d6617efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7056e356-d47e-40b2-b97e-d24c05c387ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7056e356-d47e-40b2-b97e-d24c05c387ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989ffefa-66a8-40ba-a8e2-15ffedc9059b', 'volume_name': 'volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460aeab6-3bd2-42bb-9367-ec6caea600ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460aeab6-3bd2-42bb-9367-ec6caea600ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15df44b1-882a-4c9f-a861-c0d624da5c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:37 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Volume 989ffefa-66a8-40ba-a8e2-15ffedc9059b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b', 'volume_size': 1} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-124434567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989ffefa-66a8-40ba-a8e2-15ffedc9059b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:37Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Creating volume 989ffefa-66a8-40ba-a8e2-15ffedc9059b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:09:37 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:09:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:37 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b 1073741824 Jul 11 19:09:37 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:38 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b 1073741824" returned: 0 in 0.879s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:38 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b Jul 11 19:09:38 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:39 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b" returned: 0 in 0.653s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15df44b1-882a-4c9f-a861-c0d624da5c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bc51f6-43a5-4911-a517-86c86842dc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:39 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Volume volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b (989ffefa-66a8-40ba-a8e2-15ffedc9059b): created successfully Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bc51f6-43a5-4911-a517-86c86842dc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (e42d263b-179e-45c5-9846-0b1751d2052a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-471c8cb2-2739-45c2-91b3-9792672828b4 tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Creating offline snapshot f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca of volume 989ffefa-66a8-40ba-a8e2-15ffedc9059b {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c37cca-dd57-435b-8c00-71b4d16c4d87]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:39 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b Jul 11 19:09:39 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:40 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b" returned: 0 in 0.799s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:40 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca 1G Jul 11 19:09:40 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:41 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca 1G" returned: 0 in 0.877s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:41 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca Jul 11 19:09:41 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:42 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca" returned: 0 in 0.730s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:42 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca is being set with open permissions: ugo+rw Jul 11 19:09:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:42 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca Jul 11 19:09:42 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:42 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:42 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.info Jul 11 19:09:42 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:43 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.info" returned: 0 in 0.677s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:43 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.info is being set with open permissions: ugo+rw Jul 11 19:09:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:43 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.info Jul 11 19:09:43 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:44 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.info" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.506s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9e50ba60-680f-4412-86b4-24f590b21df4 tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Lock "cinder-f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-989ffefa-66a8-40ba-a8e2-15ffedc9059b" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-989ffefa-66a8-40ba-a8e2-15ffedc9059b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca of volume 989ffefa-66a8-40ba-a8e2-15ffedc9059b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1f3bdc-d441-4247-9906-4ca81aac6eb4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:45 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca Jul 11 19:09:45 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:45 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca" returned: 0 in 0.751s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:09:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdde762-6238-4eed-a13f-908a4ba0941f]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:45 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b Jul 11 19:09:45 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:46 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b" returned: 0 in 0.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:46 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca Jul 11 19:09:46 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:47 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:47 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca Jul 11 19:09:47 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:47 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b.f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca" returned: 0 in 0.645s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca" released by "_delete_snapshot" :: held 2.922s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-989ffefa-66a8-40ba-a8e2-15ffedc9059b" released by "delete_snapshot" :: held 2.946s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Created reservations ['19ec7954-dbc3-4a05-a7c5-6d528b8531cc', 'f28348d2-974b-47f2-9bbf-e7ca34f37138', 'b4832a5b-d256-49b9-94a5-dc91be8623e0', '3a326320-2b78-43e7-9a5c-42f05d48543f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-42d8b6e3-abba-4736-a74a-a716c355a286 tempest-ProjectMemberTests-620667099 None] Lock "cinder-f3fd0bdf-4f2d-4bfa-b9af-0371dee84cca-delete_snapshot" released by "delete_snapshot" :: held 3.073s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-989ffefa-66a8-40ba-a8e2-15ffedc9059b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Lock "cinder-989ffefa-66a8-40ba-a8e2-15ffedc9059b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-989ffefa-66a8-40ba-a8e2-15ffedc9059b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-989ffefa-66a8-40ba-a8e2-15ffedc9059b" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d120b5c8-2936-47ae-ae86-115cc401bea4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:48 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b Jul 11 19:09:48 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:48 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b" returned: 0 in 0.739s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:48 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b Jul 11 19:09:48 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:49 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-989ffefa-66a8-40ba-a8e2-15ffedc9059b" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-989ffefa-66a8-40ba-a8e2-15ffedc9059b" released by "delete_volume" :: held 1.427s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Created reservations ['863bf4ae-aef1-436f-af7a-965cbdc5ead3', '2779cea4-112b-4b4b-94e9-889ccd3d6789', '2327c5dd-9b28-48d4-b717-899da3c3403e', 'e3556322-164a-4fa3-9167-23f984e1fe4c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:49 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:09:49 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:50 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.645s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:09:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12d79d6a-7848-4d7b-8b32-a40eaf0d5fb4 tempest-ProjectMemberTests-620667099 None] Lock "cinder-989ffefa-66a8-40ba-a8e2-15ffedc9059b-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (5ff8b31b-b7b6-4498-bac2-0f8fb8bf5736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ad947e-3411-41c2-abec-501e55b72280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ad947e-3411-41c2-abec-501e55b72280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-411445562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32069695-5a53-46cf-be23-e468bafb5694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:51Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63101e8-b408-4f99-a2c3-5f9759fe69e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63101e8-b408-4f99-a2c3-5f9759fe69e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26286e8e-581f-4fd0-90ef-d5b11afc2534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26286e8e-581f-4fd0-90ef-d5b11afc2534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32069695-5a53-46cf-be23-e468bafb5694', 'volume_name': 'volume-32069695-5a53-46cf-be23-e468bafb5694', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd7beb8-8894-4c3b-86ee-e482f39fbee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd7beb8-8894-4c3b-86ee-e482f39fbee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e478b2-6d52-4161-b316-3f76d6acc826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Volume 32069695-5a53-46cf-be23-e468bafb5694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32069695-5a53-46cf-be23-e468bafb5694', 'volume_size': 1} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-411445562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32069695-5a53-46cf-be23-e468bafb5694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:09:51Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Creating volume 32069695-5a53-46cf-be23-e468bafb5694 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:09:50 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:09:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:50 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 1073741824 Jul 11 19:09:50 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:51 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 1073741824" returned: 0 in 0.788s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:51 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 Jul 11 19:09:51 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:52 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e478b2-6d52-4161-b316-3f76d6acc826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32069695-5a53-46cf-be23-e468bafb5694', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51786e50-0d39-43d3-86f5-80ac255cb30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:09:52 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Volume volume-32069695-5a53-46cf-be23-e468bafb5694 (32069695-5a53-46cf-be23-e468bafb5694): created successfully Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51786e50-0d39-43d3-86f5-80ac255cb30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (5ff8b31b-b7b6-4498-bac2-0f8fb8bf5736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:09:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-29d23d3e-b26c-4da7-8cf9-4db06702db8b tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Creating offline snapshot d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 of volume 32069695-5a53-46cf-be23-e468bafb5694 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bda6340-66a8-4b4b-a865-47f8e516eeff]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:53 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 Jul 11 19:09:53 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:53 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694" returned: 0 in 0.740s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:53 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 1G Jul 11 19:09:53 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:54 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 1G" returned: 0 in 0.785s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32069695-5a53-46cf-be23-e468bafb5694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:54 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32069695-5a53-46cf-be23-e468bafb5694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 Jul 11 19:09:54 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:55 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32069695-5a53-46cf-be23-e468bafb5694 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5" returned: 0 in 0.671s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:55 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 is being set with open permissions: ugo+rw Jul 11 19:09:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:55 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 Jul 11 19:09:55 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:55 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5" returned: 0 in 0.624s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:55 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.info Jul 11 19:09:55 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:56 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.info" returned: 0 in 0.630s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:56 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.info is being set with open permissions: ugo+rw Jul 11 19:09:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:56 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.info Jul 11 19:09:56 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:57 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.info" returned: 0 in 0.630s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.153s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:09:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-705dc88b-48f3-4c34-b451-71b3f64337fa tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Lock "cinder-d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-32069695-5a53-46cf-be23-e468bafb5694" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-32069695-5a53-46cf-be23-e468bafb5694" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 of volume 32069695-5a53-46cf-be23-e468bafb5694 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd7f7c4-cc7f-43bd-bf10-b9bb029db150]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:58 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 Jul 11 19:09:58 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:59 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5" returned: 0 in 0.765s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32069695-5a53-46cf-be23-e468bafb5694(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:09:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e8dd62-9404-4eda-9d8b-d065e4a69f99]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:09:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:59 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 Jul 11 19:09:59 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:09:59 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Jul 11 19:09:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694" returned: 0 in 0.728s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:09:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:09:59 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 Jul 11 19:09:59 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:00 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5" returned: 0 in 0.721s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:00 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5 Jul 11 19:10:00 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:01 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694.d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5" released by "_delete_snapshot" :: held 2.927s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-32069695-5a53-46cf-be23-e468bafb5694" released by "delete_snapshot" :: held 2.949s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Created reservations ['7b06ba5e-036c-45a0-8b00-22a12cf1d468', 'e4503141-7437-431e-8485-e808cfc36c46', '9fe92bac-6aef-4165-b13f-a4387eeb5c9d', 'b9c416d4-537f-43ea-8a3b-64a62536e1a6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:10:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aac62d7-3f39-41fb-8d13-5211fa8f4491 tempest-ProjectMemberTests-620667099 None] Lock "cinder-d91ec89e-9f8c-4e17-ba4d-5e3559d8b8f5-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-32069695-5a53-46cf-be23-e468bafb5694-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Lock "cinder-32069695-5a53-46cf-be23-e468bafb5694-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-32069695-5a53-46cf-be23-e468bafb5694" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-32069695-5a53-46cf-be23-e468bafb5694" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b481850e-a16c-48b3-a472-69b62ec3a6d0]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:01 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 Jul 11 19:10:01 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:02 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:02 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694 Jul 11 19:10:02 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:02 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-32069695-5a53-46cf-be23-e468bafb5694" returned: 0 in 0.620s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-32069695-5a53-46cf-be23-e468bafb5694" released by "delete_volume" :: held 1.420s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Created reservations ['671a8102-c9a5-4bb5-9847-7bd62efcc4f0', '97c093f0-b5f0-45e2-805b-50be8c873378', '2b2485c7-1337-404e-a450-02a5d858fd07', '449dfb2b-f947-4c06-9597-34207a0ee7f1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:02 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:10:02 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:03 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.621s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:03 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:10:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:10:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-45ce6d26-ab30-427d-8857-f176bd778def tempest-ProjectMemberTests-620667099 None] Lock "cinder-32069695-5a53-46cf-be23-e468bafb5694-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:10:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (c55a7888-7b09-4388-bb05-7b9cd32f65c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:10:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbeb81d3-49cd-4129-b8a7-e2b0f4ae6e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbeb81d3-49cd-4129-b8a7-e2b0f4ae6e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397654361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ab93bb-d629-4578-968f-d3458430d5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:10:04Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d9aa6e-aaaf-47cf-b274-3ef0d7d8d3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d9aa6e-aaaf-47cf-b274-3ef0d7d8d3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad3295a-7fc0-4314-8cbd-1662e4d3f3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad3295a-7fc0-4314-8cbd-1662e4d3f3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ab93bb-d629-4578-968f-d3458430d5e1', 'volume_name': 'volume-b1ab93bb-d629-4578-968f-d3458430d5e1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5d3355-2ab3-4cd2-8175-ec6bd2e6421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5d3355-2ab3-4cd2-8175-ec6bd2e6421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3f8c5b-2dea-4151-8e5c-c87fe89017a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Volume b1ab93bb-d629-4578-968f-d3458430d5e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ab93bb-d629-4578-968f-d3458430d5e1', 'volume_size': 1} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397654361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ab93bb-d629-4578-968f-d3458430d5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:10:04Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Creating volume b1ab93bb-d629-4578-968f-d3458430d5e1 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:10:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:04 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 1073741824 Jul 11 19:10:04 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:04 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 1073741824" returned: 0 in 0.805s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:04 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 Jul 11 19:10:04 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:05 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1" returned: 0 in 0.633s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:10:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3f8c5b-2dea-4151-8e5c-c87fe89017a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ab93bb-d629-4578-968f-d3458430d5e1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b59192b-041f-4387-8f5c-8a4d9bc0c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Volume volume-b1ab93bb-d629-4578-968f-d3458430d5e1 (b1ab93bb-d629-4578-968f-d3458430d5e1): created successfully Jul 11 19:10:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b59192b-041f-4387-8f5c-8a4d9bc0c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (c55a7888-7b09-4388-bb05-7b9cd32f65c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:10:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-62bae916-c977-4468-8a95-ac67c31d63df tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:10:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Creating offline snapshot 9af2da4d-879e-40f7-88b5-9d11b89ec96c of volume b1ab93bb-d629-4578-968f-d3458430d5e1 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:10:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b07eb9-d46a-489f-a880-d117be6c3f61]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:06 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 Jul 11 19:10:06 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:06 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1" returned: 0 in 0.731s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:06 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c 1G Jul 11 19:10:06 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:07 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c 1G" returned: 0 in 0.783s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ab93bb-d629-4578-968f-d3458430d5e1 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:07 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ab93bb-d629-4578-968f-d3458430d5e1 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c Jul 11 19:10:07 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:08 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ab93bb-d629-4578-968f-d3458430d5e1 -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c" returned: 0 in 0.669s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:08 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c is being set with open permissions: ugo+rw Jul 11 19:10:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:08 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c Jul 11 19:10:08 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:08 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c" returned: 0 in 0.621s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:09 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.info Jul 11 19:10:09 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:09 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.info" returned: 0 in 0.635s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:09 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.info is being set with open permissions: ugo+rw Jul 11 19:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:09 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.info Jul 11 19:10:09 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:10 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.info" returned: 0 in 0.621s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.132s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-09743f3b-f0d6-44ca-bf51-7f253ec3f60b tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-9af2da4d-879e-40f7-88b5-9d11b89ec96c-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Lock "cinder-9af2da4d-879e-40f7-88b5-9d11b89ec96c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-b1ab93bb-d629-4578-968f-d3458430d5e1" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-b1ab93bb-d629-4578-968f-d3458430d5e1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-9af2da4d-879e-40f7-88b5-9d11b89ec96c" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9af2da4d-879e-40f7-88b5-9d11b89ec96c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot 9af2da4d-879e-40f7-88b5-9d11b89ec96c of volume b1ab93bb-d629-4578-968f-d3458430d5e1 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[87839bb4-fc22-4961-8e81-c5fe06b205a4]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:11 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c Jul 11 19:10:11 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:12 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c" returned: 0 in 0.742s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1ab93bb-d629-4578-968f-d3458430d5e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:10:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90a41e9-4503-47c8-af35-c980e604c821]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:12 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 Jul 11 19:10:12 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:12 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1" returned: 0 in 0.733s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:12 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c Jul 11 19:10:12 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:13 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c" returned: 0 in 0.738s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:13 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c Jul 11 19:10:13 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:14 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1.9af2da4d-879e-40f7-88b5-9d11b89ec96c" returned: 0 in 0.646s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9af2da4d-879e-40f7-88b5-9d11b89ec96c" released by "_delete_snapshot" :: held 2.940s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-b1ab93bb-d629-4578-968f-d3458430d5e1" released by "delete_snapshot" :: held 2.961s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=86,cinder:INSERT=24,cinder:UPDATE=103,cinder:DELETE=7 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=73,cinder:INSERT=30,cinder:UPDATE=96,cinder:DELETE=10 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Created reservations ['357fb5a1-b442-4ecd-abbb-49259c855b69', 'dc7579a0-798a-4f95-86e5-b2adbae2ca35', '28de177d-6ee5-4cdf-a2e5-ae26096acea6', 'fb695ef4-4a2c-4fd5-b3f9-a06e5066aa34'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:10:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-54b15e1b-d0ed-4c82-bd81-457bef17ca77 tempest-ProjectMemberTests-620667099 None] Lock "cinder-9af2da4d-879e-40f7-88b5-9d11b89ec96c-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-b1ab93bb-d629-4578-968f-d3458430d5e1-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Lock "cinder-b1ab93bb-d629-4578-968f-d3458430d5e1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-b1ab93bb-d629-4578-968f-d3458430d5e1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-b1ab93bb-d629-4578-968f-d3458430d5e1" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d306f-702f-44ff-bbe2-4d4a778bdb94]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:14 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 Jul 11 19:10:14 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:15 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:10:15 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:15 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1" returned: 0 in 0.748s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:15 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1 Jul 11 19:10:15 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:15 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:10:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bc6fbf48-d293-447f-b081-d2137e82e65b None None] thread info: [<_MainThread(MainThread, started 124350526271616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:10:16 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-b1ab93bb-d629-4578-968f-d3458430d5e1" returned: 0 in 0.643s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-b1ab93bb-d629-4578-968f-d3458430d5e1" released by "delete_volume" :: held 1.444s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Created reservations ['4eeea4be-de09-4e78-87c8-fef126c0cefd', '74fe35fd-e217-4a03-84f4-705e2a9ef625', '3b2acdda-5cf1-46ca-8edd-15992f7c424d', '435185a1-cf73-470d-82d0-ed529ff38f9f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:16 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:10:16 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:16 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.630s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:10:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:10:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-521f5c77-ac1f-4d33-bd7e-46ee9b44d645 tempest-ProjectMemberTests-620667099 None] Lock "cinder-b1ab93bb-d629-4578-968f-d3458430d5e1-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (a735608b-4bf7-426f-8379-d7918a028ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f6e8c3-e48d-4172-a584-93a3637b8e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f6e8c3-e48d-4172-a584-93a3637b8e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731253491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a49199f-9b49-4a17-aab5-7059085dea3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:10:17Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bd7b87-312c-47a5-b5bd-8c3e1abcd763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bd7b87-312c-47a5-b5bd-8c3e1abcd763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564f5113-27c8-4e7b-8bd8-4b64f1639a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564f5113-27c8-4e7b-8bd8-4b64f1639a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a49199f-9b49-4a17-aab5-7059085dea3f', 'volume_name': 'volume-9a49199f-9b49-4a17-aab5-7059085dea3f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410bc989-8305-4125-b7fb-aa69de1fcef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410bc989-8305-4125-b7fb-aa69de1fcef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e28f18-635c-41b8-b300-08de2eebf37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Volume 9a49199f-9b49-4a17-aab5-7059085dea3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a49199f-9b49-4a17-aab5-7059085dea3f', 'volume_size': 1} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731253491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a49199f-9b49-4a17-aab5-7059085dea3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbcf9b422fc496c8cc8a694c7659432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:10:17Z,use_quota=True,user_id='d3ab82353ed14d3397f6c1530cdc5a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bddc4e0-7283-4b1f-b541-f0b283152269),volume_type_id=4bddc4e0-7283-4b1f-b541-f0b283152269)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Creating volume 9a49199f-9b49-4a17-aab5-7059085dea3f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Selected osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:10:17 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] casted to osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a Jul 11 19:10:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:17 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f 1073741824 Jul 11 19:10:17 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:18 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f 1073741824" returned: 0 in 0.816s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:18 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f Jul 11 19:10:18 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:18 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f" returned: 0 in 0.652s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e28f18-635c-41b8-b300-08de2eebf37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a49199f-9b49-4a17-aab5-7059085dea3f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf5462b-ba66-4a59-8c8a-78280b142ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:10:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Volume volume-9a49199f-9b49-4a17-aab5-7059085dea3f (9a49199f-9b49-4a17-aab5-7059085dea3f): created successfully Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf5462b-ba66-4a59-8c8a-78280b142ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:10:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Flow 'volume_create_manager' (a735608b-4bf7-426f-8379-d7918a028ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:10:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e07cf2c0-15ed-48be-bf4e-6818f37cb1aa tempest-ProjectMemberTests-620667099 None] Created volume successfully. Jul 11 19:10:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Creating offline snapshot fd1a70d7-b216-473d-a073-3018a9e98bdd of volume 9a49199f-9b49-4a17-aab5-7059085dea3f {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:10:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8a0bc-596b-42d8-ad83-789e5e00e646]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:19 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f Jul 11 19:10:19 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:20 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f" returned: 0 in 0.740s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:20 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd 1G Jul 11 19:10:20 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:20 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd 1G" returned: 0 in 0.756s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a49199f-9b49-4a17-aab5-7059085dea3f -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:20 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a49199f-9b49-4a17-aab5-7059085dea3f -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd Jul 11 19:10:20 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:21 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a49199f-9b49-4a17-aab5-7059085dea3f -F qcow2 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd" returned: 0 in 0.659s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:21 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd is being set with open permissions: ugo+rw Jul 11 19:10:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:21 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd Jul 11 19:10:21 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:22 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd" returned: 0 in 0.619s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:22 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.info Jul 11 19:10:22 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:22 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.info" returned: 0 in 0.631s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:22 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.info is being set with open permissions: ugo+rw Jul 11 19:10:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:22 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.info Jul 11 19:10:22 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:23 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.info" returned: 0 in 0.636s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.115s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ea1157f0-a840-43c3-93b3-fed31922dd43 tempest-ProjectMemberTests-620667099 None] Create snapshot completed successfully Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-fd1a70d7-b216-473d-a073-3018a9e98bdd-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Lock "cinder-fd1a70d7-b216-473d-a073-3018a9e98bdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-9a49199f-9b49-4a17-aab5-7059085dea3f" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9a49199f-9b49-4a17-aab5-7059085dea3f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-fd1a70d7-b216-473d-a073-3018a9e98bdd" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-fd1a70d7-b216-473d-a073-3018a9e98bdd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Deleting offline snapshot fd1a70d7-b216-473d-a073-3018a9e98bdd of volume 9a49199f-9b49-4a17-aab5-7059085dea3f {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] snapshot_file for this snap is: volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[812ca469-21b9-4575-9682-8417b1a35475]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:24 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd Jul 11 19:10:24 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:25 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd" returned: 0 in 0.746s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a49199f-9b49-4a17-aab5-7059085dea3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:10:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[04918c5d-b557-4f50-ad77-02ecc7b90890]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:25 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f Jul 11 19:10:25 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:26 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f" returned: 0 in 0.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:26 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd Jul 11 19:10:26 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:27 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd" returned: 0 in 0.719s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:27 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd Jul 11 19:10:27 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:27 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f.fd1a70d7-b216-473d-a073-3018a9e98bdd" returned: 0 in 0.623s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-fd1a70d7-b216-473d-a073-3018a9e98bdd" released by "_delete_snapshot" :: held 2.914s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9a49199f-9b49-4a17-aab5-7059085dea3f" released by "delete_snapshot" :: held 2.934s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Created reservations ['d43f9c92-f551-4c54-b3fa-d5a5ffe46dc5', '13faacda-3b78-4efb-b447-0f10cb40411e', 'a6d01544-4f3b-4b8d-a878-bd7ac7c45aca', '1d0cb13b-4886-4dca-965c-eccec22d8791'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:10:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Delete snapshot completed successfully. Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bf0a7a4c-2f81-4de0-9357-8697f21b73f8 tempest-ProjectMemberTests-620667099 None] Lock "cinder-fd1a70d7-b216-473d-a073-3018a9e98bdd-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-9a49199f-9b49-4a17-aab5-7059085dea3f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Lock "cinder-9a49199f-9b49-4a17-aab5-7059085dea3f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Acquiring lock "cinder-quobyte-9a49199f-9b49-4a17-aab5-7059085dea3f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9a49199f-9b49-4a17-aab5-7059085dea3f" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adf7178-53f5-476c-b019-f859c964d52c]: (4, 'qcow2') {{(pid=88535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:10:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:28 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f Jul 11 19:10:28 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:28 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f" returned: 0 in 0.762s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:28 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f Jul 11 19:10:28 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:29 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c/volume-9a49199f-9b49-4a17-aab5-7059085dea3f" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Lock "cinder-quobyte-9a49199f-9b49-4a17-aab5-7059085dea3f" released by "delete_volume" :: held 1.453s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Created reservations ['eb4d79ee-b5c3-4bd7-b152-a0041321ae01', '9146d57c-0136-48fd-99c8-15a85ca9d8dc', '17ca5325-961c-499b-89c5-4ef494137c4d', 'c385c091-0c19-4a99-b989-d5d39641fbcc'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbcb38ea-73f2-439c-b239-2e0db37a4e0a'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:10:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:10:29 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c Jul 11 19:10:29 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:10:30 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Jul 11 19:10:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78a2d406d47f4a83f5302c0657672d8c" returned: 0 in 0.641s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:10:30 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:10:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Deleted volume successfully. Jul 11 19:10:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e09133b-b97d-4d0d-a297-77e519ea3168 tempest-ProjectMemberTests-620667099 None] Lock "cinder-9a49199f-9b49-4a17-aab5-7059085dea3f-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:10:39 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:INSERT=8,cinder:SELECT=21,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:10:40 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}